Ładowanie opisu…

Senior Data Engineer (Spark) w Poznań, Polska - Jobeax

Senior Data Engineer (Spark) w Poznań, Polska is listed on Jobeax. Browse 110,000+ vacancies available.

What you’ll need to succeed in this role:

At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.
Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.
Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD.
Excellent understanding of dimensional data and data modeling techniques.
Experience implementing and deploying solutions in cloud environments.
Consulting experience with excellent communication and client management skills, including prior experience directly interacting with clients as a consultant.
Ability to work independently and take ownership of project deliverables.
Fluent English (at least C1 level).
Bachelor’s degree in technical or mathematical studies.

Addepto is a leading AI consulting (https://jobeax.com/link/rOiEvBn3dZ9KkGj7 and data engineering (https://jobeax.com/link/cLdQJ7azj7GOWKYv company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With an exclusive focus on Artificial Intelligence and Big Data, Addepto helps organizations unlock the full potential of their data through systems designed for measurable business impact and long-term growth.

The company's work extends beyond client engagements. Drawing from real-world challenges and insights, Addepto has developed its own product - ContextClue - and actively contributes open-source solutions to the AI community. This commitment to transforming practical experience into scalable innovation has earned Addepto recognition by Forbes as one of the top 10 AI consulting companies worldwide.

As part of KMS Technology, a US-based global technology group, Addepto combines deep AI specialization with enterprise-scale delivery capabilities—enabling the partnership to move clients from AI experimentation to production impact, securely and at scale.

As a Senior Data Engineer , you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:

Design and development of the platform for managing vehicle data for global automotive company. This project develops a shared platform for processing massive car data streams. It ingests terabytes of daily data, using both streaming and batch pipelines for near real-time insights. The platform transforms raw data for data analysis and Machine Learning, this empowers teams to build real-world applications like digital support and smart infotainment and unlocks data-driven solutions for car maintenance and anomaly detection across the organization.
Design and development of a universal data platform for global aerospace companies. This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is at the early stages of the development, covering design of architecture and processes as well as giving freedom for technology selection.

Discover our perks and benefits:

Work in a supportive team of passionate enthusiasts of AI & Big Data.
Engage with top-tier global enterprises and cutting-edge startups on international projects.
Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
Accelerate your professional growth through career paths , knowledge-sharing initiatives, language classes, and sponsored training or conferences , including a partnership with Databricks and Anthropic , which offers industry-leading training materials and certifications.
Participate in team-building events and utilize the integration budget .
Celebrate work anniversaries, birthdays, and milestones.
Access medical and sports packages , eye care, and well-being support services, including psychotherapy and coaching.
Get full work equipment for optimal productivity, including a laptop and other necessary devices.
With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.
Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.

,[Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability., Design and implement data pipelines that process large volumes of data in both streaming and batch modes., Optimize data workflows to ensure efficient data ingestion, processing, and storage using technologies such as Spark, Cloudera, and Airflow., Work with data lake technologies (e.g., Iceberg) to manage structured and unstructured data efficiently., Collaborate with cross-functional teams to understand data requirements and ensure seamless integration of data sources., Monitor and troubleshoot the platform, ensuring high availability, performance, and accuracy of data processing., Leverage cloud services (AWS) for infrastructure management and scaling of processing workloads., Write and maintain high-quality Python (or Java/Scala) code for data processing tasks and automation.] Requirements: Python, SQL, Spark, Airflow, AWS, CI/CD, Kubernetes, Kafka, NiFi, Java, Scala, Docker, Databricks, DevOps, Iceberg, Cloudera Tools: Jira, Confluence, Wiki, GitHub, Agile, Scrum, Kanban. Additionally: Private healthcare, Multisport card, Referral bonus, MyBenefit cafeteria, International projects, Flat structure, Paid leave, Training budget, Language classes, Team building events, Small teams, Flexible form of employment, Flexible working hours and remote work possibility, Free coffee, Startup atmosphere, No dress code, In-house trainings.

Aplikuj na ofertę

Podobne oferty

Więcej podobnych stanowisk

DCG Poland

Senior Big Data Engineer - Spark, Scala, Python, AWS

Dzisiaj

DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...

Poland, Łódź

B2Bnetwork

Senior Data Engineer - Scala / Spark / Hadoop (f/m)

5 dni temu

... will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using Hadoop and Apache Spark. Build scalable solutions for processing large volumes of data. Analyse complex business requirements and ...

Poland, Warszawa

Senior Data Engineer (Java/Scala, Spark, AWS)

Dzisiaj

Kontrakt

$2k USD

We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...

Poland, Warszawa

Data Engineer - Python, Spark & Cloud Data Pipelines

1 dzień temu

Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset. Enjoy a flexible work environment, ...

Poland, Warszawa

Diverse CG Sp. z o.o. Sp.k.

Senior ML Engineer - MLOps, Spark & AWS Expert

1 dzień temu

DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets. The role involves collaboration with data scientists, DevOps, and IT to deliver ...

Poland, Warszawa

Scalosoft

Senior Data Engineer

Dzisiaj

Kontrakt

170 zł PLN

... min. B2+ , - stawka do 170 zł/h przy B2B w zależności od doświadczenia. Ta oferta jest dla Ciebie, jeśli: - posiadasz doświadczenie komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, ...

Poland, Kraków

Senior Data Engineer

Dzisiaj

Zdalnie
Kontrakt

Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...

Poland, Warszawa

Senior Data Engineer

Dzisiaj

Zdalnie
Kontrakt

... Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve large-scale Big Data and cloud-native platforms for global clients, including ...

Poland, Warszawa

ASTRAL FOREST PROSTA SPÓŁKA AKCYJNA

Data Engineer - Senior

Dzisiaj

Zdalnie

1k zł PLN / year

Expected, Google Cloud Platform Data and Analytics, Python, dbt, Airflow, Terraform, GitHub Operating system, Windows About the project, We're looking for a senior Data Engineer who can step into an environment someone else built, work out how it really runs, and make it better. Most of our work is picking up existing platforms ...

Poland, Warszawa

Senior Data Engineer

1 dzień temu

Kontrakt

20000 - 28000 zł

... data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work leveraging good practices of software development: TDD, Clean Code, ...

Poland, Warszawa

Hiberus Poland

Senior Data Engineer

3 dni temu

1k - 4700

... beginning. With Hiberus, you can build a long-term career. Opis stanowiska Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Główne obowiązki : Projektowanie, rozwój i utrzymanie skalowalnych data ...

Poland, Wrocław

Senior Data Engineer

13 dni temu

25200 - 30240 zł

... ensuring transparency, collaboration, and continuous improvement. Required skills: • 5 years of experience in Data Engineering. • Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse. • Advanced programming skills in Python, PySpark, and ...

Poland, Wrocław

Senior Data Software Engineer

13 dni temu

Kontrakt

$2k USD

We are looking for a Senior Data Software Engineer to join our growing Data Practice and make our team even stronger. Our projects and technologies are very diverse and cover all technologies currently on the market and represented by open-source communities. We are providing our service to Clients in different domains: ...

Poland, Poznań

Senior AI Data Software Engineer

3 dni temu

Kontrakt

$2k USD

... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...

Poland, Katowice

Senior Data Engineer (ADF/Airflow)

12 dni temu

Hybrydowo
Stacjonarnie

29400 - 33600 zł

For our Danish client, we're looking for a Senior Data Engineer to lead the migration of existing Airflow workflows to Azure Data Factory (ADF) and support the data layer behind our reporting solutions. The role is primarily focused on data engineering, ideally with a good understanding of Power BI and reporting environments. ...

Poland, Warszawa

Senior Data Engineer (Snowflake, AWS)

13 dni temu

Kontrakt

$2k USD

We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...

Poland, Katowice

Senior AI Data Software Engineer

13 dni temu

Kontrakt

Poland, Poznań

Capgemini

Senior Data Platform Engineer- Cloud Data Pipelines & MLOps

5 dni temu

Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models. Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming ...

Poland, Poznań

Sii Poland

Senior Data Engineer — Pharma Data Platform (Python + AWS)

5 dni temu

Sii Poland is seeking an experienced Senior Data Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based ...

Poland, Rzeszów