Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska

Senior / Lead Data Software Engineer (Python, Spark, Azure) Miejsce pracy: Wrocław Technologies we use Expected - Pytest - Spark - Microsoft Azure - PySpark - Docker - Kubernetes - Terraform Cloud - Gtilab About the project We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready ...

DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...

... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Kafka, NiFi, Docker, and Iceberg. - Excellent understanding of dimensional data and data modeling ...

Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...

Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...

... koncentrujesz się na rozwoju produktu Skład zespołu, backend developer, devOps, product owner Twój zakres obowiązków, Projektowanie, rozwijanie i utrzymywanie rozwiązań Data Engineering w środowisku Hadoop i Apache Spark., Tworzenie skalowalnych procesów przetwarzania dużych zbiorów danych., Analizowanie złożonych wymagań biznesowych ...

Senior Data Engineer (Java/Scala, Spark, AWS) Miejsce pracy: Warszawa Technologies we use Expected - Spark - Java - Scala - SQL Optional - Databricks - Snowflake About the project We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power ...

Expected, Spark, Java, Scala, SQL Optional, Databricks, Snowflake About the project, We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures ...

We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...

... combines strong hands-on engineering capabilities with a deep understanding of modern Azure data platforms, Databricks Lakehouse architecture, and regulated data environments. This is how we work, at the client's site Your responsibilities, Develop and maintain data pipelines using Azure Databricks, Python, PySpark, Spark ...

... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...

... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...

... infrastruktury chmurowej CZEGO OD CIEBIE OCZEKUJEMY? Must have: Minimum 3 lata komercyjnego doświadczenia w obszarze Data Engineering Bardzo dobra znajomość Google Cloud Platform Praktyczne doświadczenie z BigQuery, Apache Airflow / Cloud Composer oraz dbt Bardzo dobra znajomość SQL Praktyczna znajomość Python Doświadczenie w ...

... technicznej i run-booków Nasze wymagania - 4+ lat doświadczenia w budowaniu i wdrażaniu rozwiązań Big Data na środowiskach produkcyjnych - Biegła znajomość PySpark, Spark-SQL, DataFrames oraz Structured Streaming - Doświadczenie w integracji Sparka z MongoDB (MongoDB Spark Connector), praktyczna znajomość modelowania dokumentowego ...

... and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. ...

... Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based data solutions, build robust pipelines, ...

Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg, Django Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Backend / Data Engineer (Python/Django), you will join a senior engineering team working on a greenfield data platform. You will be involved ...

... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...