Senior Data Engineer (Java/Scala, Spark, AWS) w Warszawa, Polska
EPAM Systems (Poland) sp. z o.o.
KontraktUmowa czasowa lub freelancing
Warszawa, Polska
Your responsibilities
Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark
Develop and support data platforms that enable AI/ML and Generative AI applications
Architect and implement solutions within AWS cloud environments using cloud-native patterns
Build and optimize ETL/ELT workflows to support analytical and operational use cases
Implement data modeling strategies aligned with modern data lakehouse architectures
Ensure data quality, governance, and monitoring across all data assets
Deliver secure, scalable, and highly available data solutions following operational best practices
Collaborate with cross-functional teams to support AI-driven business initiatives
Write advanced SQL queries and production-grade code in Java or Scala
Our requirements
5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications
Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala
Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives
Expertise in AWS cloud environments and cloud-native architectures
Advanced proficiency in SQL
Skills in data modeling and modern data lakehouse architectures
Understanding of data quality, governance, monitoring, and operational best practices
Competency in building secure, scalable, and highly available data solutions
Showcase of ETL/ELT development experience
Proficiency in English at an Upper-Intermediate level (B2) or higher
Optional
Hands-on experience with Databricks or Snowflake, with the ability to work across modern cloud-based data platforms (experience with both is advantageous)
Background in Financial Services
What we offer
We gather like-minded people:
• Top tech minds driving innovation in AI, cloud and digital platform modernization
• Supportive team and agile, startup-like culture
• Hybrid by design mode and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities
We provide growth opportunities:
• Career development programs
• Thought leadership, mentoring, soft skills and well-being programs
Expected, Spark, Java, Scala, SQL Optional, Databricks, Snowflake About the project, We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures ...
... data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, ...
... proponowanie działań naprawczych, Praca hybrydowa - 3 dni w tygodniu z Warszawy (WARUNEK KONIECZNY), Stawka: do 200 zł netto + VAT/H/B2B Min. 4 lata doświadczenia w Big Data Engineering (mile widziane doświadczenie w bankowości), Bardzo dobra znajomość: Spark, Java, SQL, Hive, Znajomość narzędzi i technologii: (mile widziane) Python, ...
Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
... maintaining scalable data pipelines using Apache Spark, Implementing ETL/ELT processes and transformations for large volumes of data, Developing and maintaining data processing components using Java, Optimizing the performance of Spark applications and data processing workflows, Integrating data from various sources and preparing ...
... dzielenie się wiedzą oraz wspieranie rozwoju technicznego zespołu. Minimum 5 lata praktycznego doświadczenia jak Data Engineer lub Big Data, Bardzo dobra znajomość PySpark, Spark SQL, DataFrames oraz Structured Streaming., Doświadczenie w odczycie i zapisie danych w MongoDB z wykorzystaniem MongoDB Spark Connector., Praktyczne ...