Senior Big Data Engineer - Spark, Scala, Python, AWS w… - Jobeax
Opis oferty
Senior Big Data Engineer - Spark, Scala, Python, AWS w Łódź, Polska
DCG Poland
Łódź, Polska
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus on quality and continuous improvement. The role offers private medical care and support from a dedicated consultant.
... działań naprawczych, Praca hybrydowa - 3 dni w tygodniu z Warszawy (WARUNEK KONIECZNY), Stawka: do 200 zł netto + VAT/H/B2B Min. 4 lata doświadczenia w Big Data Engineering (mile widziane doświadczenie w bankowości), Bardzo dobra znajomość: Spark, Java, SQL, Hive, Znajomość narzędzi i technologii: (mile widziane) Python, CI/CD, ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
... oraz SQL . - Biegła znajomość języka angielskiego. Mile widziane: - Doświadczenie z DevOps, CI/CD oraz architekturą mikroserwisów i API . - Znajomość narzędzi Big Data oraz systemu kontroli wersji Git . - Znajomość Pythona , w tym w kontekście Airflow . Wspólnie z naszym Partnerem, jednym z europejskich liderów w branży ...
... requirements - 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications - Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala - Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives ...
... data storage and processing Our requirements - Proficiency in Python and Spark with at least 3 years in data engineering roles - Strong experience with Azure Databricks and PySpark - Proven expertise in designing and implementing ETL/ELT solutions - Experience migrating big data platforms to Azure-native services - Proficiency ...
... Our requirements - Proven experience as a Data Engineer / Spark Developer in big data or cloud ecosystems. - Strong knowledge of Apache Spark, especially in data processing and ETL pipeline development. - Hands on experience with MongoDB and ODS type data store architectures. - Practical experience in Data Lakehouse technologies ...
Kraków, Polska
Zobacz ofertę
HIBERUS POLAND SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Expected, Spark SQL, Hive, SQL, Apache Spark About the project, We are looking for a Business Data Analyst to join a large Nordic bank and work on Data Products. You will act as a bridge between business needs and developers, helping to deliver high-quality IT solutions and to build common capabilities for Data Products. ...
... role works across Data Engineering, Product, Risk and Commercial teams to turn business problems into measurable AI solutions. Strong production ML experience, Python, Spark/PySpark, SQL and ML lifecycle expertise are central to the position. Day to day that means the Senior AI/ML Engineer – Applied AI Lead takes machine learning ...