Senior Data Engineer - Python, Spark, AWS w Warszawa,… - Jobeax
Opis oferty
Senior Data Engineer - Python, Spark, AWS w Warszawa, Polska
Link Group
35000 zł
Warszawa, Polska
5+ years of experience in Python and strong software engineering skills
Solid knowledge of AWS cloud services and best practices
Experience building scalable Spark pipelines in PySpark or Scala
Practical experience with Spark Streaming for low-latency pipelines
Familiarity with Delta Lake and modern data lakehouse architectures
Hands-on experience with Kubernetes and container orchestration
Experience with MongoDB and other NoSQL data stores
Understanding of microservices and event-driven architecture
Excellent communication skills and ability to work in a collaborative, global team
Commitment to high standards of ethics, quality, and delivery
Nice to Have:
Familiarity with Machine Learning , AI models , or Data Science workflows
We’re looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating modern data lakehouse components, and supporting the company’s AWS-based infrastructure.
,[Design and build scalable data ingestion pipelines in AWS, Work extensively with Databricks, including Unity Catalog, streaming, Delta Lake, and data transformation tools, Lead technical delivery and implementation of core platform components across raw, normalized, operational, and historical layers, Collaborate with engineering managers and cross-functional teams across the US and Poland, Drive technical excellence by improving team processes, architecture standards, and engineering best practices, Support and consult with stakeholders to ensure successful delivery of data-driven solutions, Contribute to the growth and maturity of the team’s cloud and data engineering capabilities] Requirements: Python, AWS, Cloud, Spark, PySpark, Scala, Kubernetes, MongoDB, NoSQL, Microservices, Communication skills, Machine learning, AI, Data science Additionally: Sport subscription, Private healthcare.
... data storage and processing Our requirements - Proficiency in Python and Spark with at least 3 years in data engineering roles - Strong experience with Azure Databricks and PySpark - Proven expertise in designing and implementing ETL/ELT solutions - Experience migrating big data platforms to Azure-native services - Proficiency ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
... requirements - 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications - Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala - Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives ...
... technical field - 5+ years experience in software development with Big Data technologies - Advanced knowledge of Python, Scala, or Java - Proficient with Spark and Databricks and/or Snowflake - Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services - Demonstrated experience with big data models, ...
... role works across Data Engineering, Product, Risk and Commercial teams to turn business problems into measurable AI solutions. Strong production ML experience, Python, Spark/PySpark, SQL and ML lifecycle expertise are central to the position. Day to day that means the Senior AI/ML Engineer – Applied AI Lead takes machine learning ...
... Our requirements - Proven experience as a Data Engineer / Spark Developer in big data or cloud ecosystems. - Strong knowledge of Apache Spark, especially in data processing and ETL pipeline development. - Hands on experience with MongoDB and ODS type data store architectures. - Practical experience in Data Lakehouse technologies ...
Kraków, Polska
Zobacz ofertę
HIBERUS POLAND SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Expected, Spark SQL, Hive, SQL, Apache Spark About the project, We are looking for a Business Data Analyst to join a large Nordic bank and work on Data Products. You will act as a bridge between business needs and developers, helping to deliver high-quality IT solutions and to build common capabilities for Data Products. ...
... experience as a Data Engineer - Expertise in Azure Data Platform with strong experience in Azure Databricks - Solid knowledge of Apache Spark and distributed data processing - Excellent skills in Python and SQL - Experience with Data Lake architectures - Strong understanding of data modeling and data processing principles ...
- - Bardzo dobra znajomość Python. - Praktyczna znajomość co najmniej jednego frameworka (FastAPI, Flask, Django). - Znajomość zasad projektowania REST API: operacje CRUD, obsługa błędów, walidacja danych, wersjonowanie. - Doświadczenie w budowaniu warstwy persystencji w oparciu o SQL (PostgreSQL) i NoSQL (Redis) — modelowanie ...