Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
Senior / Lead Data Software Engineer (Python, Spark, Azure) Miejsce pracy: Wrocław Technologies we use Expected - Pytest - Spark - Microsoft Azure - PySpark - Docker - Kubernetes - Terraform Cloud - Gtilab About the project We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready ...
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Kafka, NiFi, Docker, and Iceberg. - Excellent understanding of dimensional data and data modeling ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Kafka, NiFi, Docker, and Iceberg. - Excellent understanding of dimensional data and data modeling ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
... koncentrujesz się na rozwoju produktu Skład zespołu, backend developer, devOps, product owner Twój zakres obowiązków, Projektowanie, rozwijanie i utrzymywanie rozwiązań Data Engineering w środowisku Hadoop i Apache Spark., Tworzenie skalowalnych procesów przetwarzania dużych zbiorów danych., Analizowanie złożonych wymagań biznesowych ...
Senior Data Engineer (Java/Scala, Spark, AWS) Miejsce pracy: Warszawa Technologies we use Expected - Spark - Java - Scala - SQL Optional - Databricks - Snowflake About the project We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power ...
Expected, Spark, Java, Scala, SQL Optional, Databricks, Snowflake About the project, We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures ...
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
... combines strong hands-on engineering capabilities with a deep understanding of modern Azure data platforms, Databricks Lakehouse architecture, and regulated data environments. This is how we work, at the client's site Your responsibilities, Develop and maintain data pipelines using Azure Databricks, Python, PySpark, Spark ...
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
... infrastruktury chmurowej CZEGO OD CIEBIE OCZEKUJEMY? Must have: Minimum 3 lata komercyjnego doświadczenia w obszarze Data Engineering Bardzo dobra znajomość Google Cloud Platform Praktyczne doświadczenie z BigQuery, Apache Airflow / Cloud Composer oraz dbt Bardzo dobra znajomość SQL Praktyczna znajomość Python Doświadczenie w ...
... technicznej i run-booków Nasze wymagania - 4+ lat doświadczenia w budowaniu i wdrażaniu rozwiązań Big Data na środowiskach produkcyjnych - Biegła znajomość PySpark, Spark-SQL, DataFrames oraz Structured Streaming - Doświadczenie w integracji Sparka z MongoDB (MongoDB Spark Connector), praktyczna znajomość modelowania dokumentowego ...
... Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based data solutions, build robust pipelines, ...
... also looking for talented engineers to join other exciting data projects, including: - Development and maintenance of a large platform for processing automotive data. A significant amount of data is processed in both streaming and batch modes. The technology stack includes Spark, Cloudera, Airflow, Iceberg, Python, and AWS. ...