Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
... exemplary projects: Petabyte-scale data platform migration to Google Cloud Migration of 1,000+ active pipelines to GCP. Rearchitecture of Spark applications to Cloud Dataproc or BigQuery SQL. Automation with Cloud Composer. Data analytics platform for an investing company Azure-based data platform with Databricks as the central ...
... Databricks , Apache Spark or PySpark . - Knowledge of Apache Airflow (orchestration). - Familiarity with Azure DevOps or GitHub Actions (CI/CD). You will join an engineering team responsible for building modern cloud data lake / data platform solutions. Tools like Databricks, cloud-native services, and CI/CD pipelines will be ...
Luxoft is seeking a data-focused developer in Wrocław, Poland, to join their technology team. The role involves developing scalable web applications and building user interfaces using data from various APIs. Applicants should possess strong SQL, Python skills, and experience with cloud data platforms like AWS. Responsibilities ...
... and consistency., Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality., Ensure data security, compliance, and governance best practices are followed across all data pipelines.] Requirements: Python, SQL, ETL, Azure, Databricks, Spark, Docker, ...
... from architecture to deployment, collaborating with a modern, high‑performing engineering team. What makes you a great fit: - 5+ years of professional data engineering experience - 2+ years working with programmatic advertising or ad-tech data - Strong proficiency in Python and SQL - Experience with streaming data platforms ...
... migrating the Pricing team to a new target data platform. Work with technical teams on data architecture decisions. Key Requirements Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing. Experience working with SQL and Python for data ingestion, ...
... dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania Minimum 6 lat komercyjnego doświadczenia w programowaniu w języku Python lub Go Doświadczenie w pracy z co najmniej jednym z narzędzi: Apache Airflow, Spark, Beam, NiFi, Flink Biegłość w SQL (PostgreSQL) i NoSQL - key-value, dokumentowe, ...
... enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities Build and maintain Python-based ETL/ELT workflows for data ingestion, ...
... technology and build a more sustainable, more inclusive world. Your Team Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across ...
... Proven leadership of engineering teams - Strong hands-on knowledge of modern data platforms such as Databricks - Experience with data pipeline orchestration, data modeling, data quality frameworks, and observability stacks - Familiarity with unstructured data processing and GenAI enablement pipelines is highly desirable ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
... cloud-based data transformation Solid background in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing ...
... zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with ...
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
... colleagues ask to check their work, keep reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes ...
... years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work leveraging good practices of ...
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
... software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, databases, and tools Strong understanding of ...
... Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience with relational databases Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments Strong programming skills in Python, Scala, or Java Experience with ...