Senior Data Engineer - Python, Spark, AWS w Warszawa,… - Jobeax
Opis oferty
Senior Data Engineer - Python, Spark, AWS w Warszawa, Polska
Link Group
35000 zł
Warszawa, Polska
5+ years of experience in Python and strong software engineering skills
Solid knowledge of AWS cloud services and best practices
Experience building scalable Spark pipelines in PySpark or Scala
Practical experience with Spark Streaming for low-latency pipelines
Familiarity with Delta Lake and modern data lakehouse architectures
Hands-on experience with Kubernetes and container orchestration
Experience with MongoDB and other NoSQL data stores
Understanding of microservices and event-driven architecture
Excellent communication skills and ability to work in a collaborative, global team
Commitment to high standards of ethics, quality, and delivery
Nice to Have:
Familiarity with Machine Learning , AI models , or Data Science workflows
We’re looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating modern data lakehouse components, and supporting the company’s AWS-based infrastructure.
,[Design and build scalable data ingestion pipelines in AWS, Work extensively with Databricks, including Unity Catalog, streaming, Delta Lake, and data transformation tools, Lead technical delivery and implementation of core platform components across raw, normalized, operational, and historical layers, Collaborate with engineering managers and cross-functional teams across the US and Poland, Drive technical excellence by improving team processes, architecture standards, and engineering best practices, Support and consult with stakeholders to ensure successful delivery of data-driven solutions, Contribute to the growth and maturity of the team’s cloud and data engineering capabilities] Requirements: Python, AWS, Cloud, Spark, PySpark, Scala, Kubernetes, MongoDB, NoSQL, Microservices, Communication skills, Machine learning, AI, Data science Additionally: Sport subscription, Private healthcare.
... data storage and processing Our requirements - Proficiency in Python and Spark with at least 3 years in data engineering roles - Strong experience with Azure Databricks and PySpark - Proven expertise in designing and implementing ETL/ELT solutions - Experience migrating big data platforms to Azure-native services - Proficiency ...
Senior / Lead Data Software Engineer (Python, Spark, Azure) Miejsce pracy: Wrocław Technologies we use Expected - Pytest - Spark - Microsoft Azure - PySpark - Docker - Kubernetes - Terraform Cloud - Gtilab About the project We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
... of a large platform for processing automotive data. A significant amount of data is processed in both streaming and batch modes. The technology stack includes Spark, Cloudera, Airflow, Iceberg, Python, and AWS. - Design and development of a universal data platform for global aerospace companies. This Azure and Databricks ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
... koncentrujesz się na rozwoju produktu Skład zespołu, backend developer, devOps, product owner Twój zakres obowiązków, Projektowanie, rozwijanie i utrzymywanie rozwiązań Data Engineering w środowisku Hadoop i Apache Spark., Tworzenie skalowalnych procesów przetwarzania dużych zbiorów danych., Analizowanie złożonych wymagań biznesowych ...
... requirements - 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications - Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala - Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives ...
Senior Data Engineer (Java/Scala, Spark, AWS) Miejsce pracy: Warszawa Technologies we use Expected - Spark - Java - Scala - SQL Optional - Databricks - Snowflake About the project We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power ...
Expected, Spark, Java, Scala, SQL Optional, Databricks, Snowflake About the project, We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures ...