Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
Poland, Kraków
8k
Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...
Poland, Warszawa
Hiberus Poland
1k - 4700
... beginning. With Hiberus, you can build a long-term career. Opis stanowiska Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Główne obowiązki : Projektowanie, rozwój i utrzymanie skalowalnych data ...
Poland, Wrocław
Scalosoft
170 zł PLN
... min. B2+ , - stawka do 170 zł/h przy B2B w zależności od doświadczenia. Ta oferta jest dla Ciebie, jeśli: - posiadasz doświadczenie komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, ...
Poland, Kraków
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
Poland, Warszawa
ASTRAL FOREST PROSTA SPÓŁKA AKCYJNA
1k zł PLN / year
... to set the direction, •Review the work of other engineers and say clearly when something needs reworking, •Stay up-to-date with trends and new technologies in data engineering, , DevOps & Quality, •Work with Terraform, GitHub and CI/CD pipelines across the full deployment lifecycle, •Ensure high standards of data quality, ...
Poland, Warszawa
20000 - 28000 zł
... resolving issues reported through organizational communication channels (Slack, email, OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, ...
Poland, Warszawa
A1 Sorter
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
Poland, Zakroczym
Luxoft is seeking a data-focused developer in Wrocław, Poland, to join their technology team. The role involves developing scalable web applications and building user interfaces using data from various APIs. Applicants should possess strong SQL, Python skills, and experience with cloud data platforms like AWS. Responsibilities ...
Poland, Wrocław
POLENERGIA S.A.
Data Engineer (m/k) Miejsce pracy: Warszawa Technologie, których używamy Wymagane - Microsoft Azure - Azure DataBricks - Azure Data Factory - Unity Catalog - SQL - Python Tak organizujemy naszą pracę Tak pracujemy - wewnątrz organizacji Twój zakres obowiązków - Projektowanie, implementacja i utrzymanie procesów ...
Poland, Warszawa
NEONTRI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Data Engineer (K/M) Miejsce pracy: Warszawa Technologie, których używamy Wymagane - SQL - GCP - Big Data - Data Warehouse - Data Lake - ETL/ELT - Feature Store - Customer 360 - Golden Record - CRM O projekcie Cześć! Z tej strony Neontri - jesteśmy firmą liczącą ponad 120 osób. Specjalizujemy się w dwóch obszarach: ...
Poland, Warszawa
WYMAGANIA: Minimum 4 lata doświadczenia na stanowisku Data Engineera lub w pokrewnej roli Bardzo dobra znajomość Python oraz SQL Doświadczenie w budowie i utrzymaniu pipeline’ów danych (ETL/ELT) Praktyczna znajomość pracy z danymi ustrukturyzowanymi i nieustrukturyzowanymi (transformacje, normalizacja, przygotowanie) Umiejętność ...
Poland, Warszawa
26880 - 31920 zł
... contract: B2B, long term cooperation Model of work: hybrid, 1 day per week work from office (Gdańsk/ Warsaw/ Łódź) Introduction & Summary We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, specifically focused on supporting corporate lending operations. The ideal candidate must be ...
Poland, Gdańsk
130 zł PLN - 160 zł PLN
130 - 160 zł / stawka godzinowa Forma współpracy: Kontrakt B2B z IT LeasingTeam. Długofalowy kontrakt z gwarancją rozwoju w zespole wybitnych ekspertów technicznych, Tryb pracy: W pełni zdalny Zasugerowane Stawka godzinowa Praca zdalna
Poland, Bydgoszcz
26880 - 28560 zł
... SQL and Snowflake. Good understanding of data modelling, ETL/ELT processes and data integration. Experience working with large datasets and designing scalable data pipelines. Knowledge of data quality, validation and monitoring practices. Familiarity with cloud-based data platforms and modern data engineering concepts. Experience ...
Poland, Warszawa
21000 - 28560 zł
... (at least C1 level). - Bachelor’s degree in technical or mathematical studies. Addepto is a leading AI consulting (https://jobeax.com/link/rOiEvBn3dZ9KkGj7 and data engineering (https://jobeax.com/link/cLdQJ7azj7GOWKYv company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering ...
Poland, Poznań
120 zł PLN / month
... scalable data pipelines, datasets, and data models. The primary focus is on enabling accurate process analysis and supporting continuous improvement through robust data engineering and efficient integration of multiple source systems. Data Engineer - Process Mining Requirements: 3 to 5 years of experience in similar position. ...
Poland, Kraków
200 zł PLN
... Proficiency in at least one programming language, preferably Python. Strong knowledge of AWS cloud services including S3, Glue, and Lambda. Solid understanding of databases and data processing pipelines. Hands-on experience with software engineering best practices. Familiarity with Generative AI technologies. Strong problem-solving ...
Poland, Warszawa
Accenture Technology
... scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently. - Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms). - Collaborate with cross‑functional teams including data engineers, data ...
Poland, Warszawa
DataArt Poland sp. z o.o.
18000 - 21800 zł
... and non-functional business requirements 5+ years of experience or 5+ completed projects, Advanced SQL and query optimization, with proficiency across popular database variations, Python for data engineering and automation, Cloud data platforms: Snowflake and/or Databricks, Cloud services: AWS and/or Azure, Data transformation ...
Poland, Warszawa