Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
20000 - 28000 zł
... resolving issues reported through organizational communication channels (Slack, email, OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, ...
Poland, Warszawa
A1 Sorter
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
Poland, Zakroczym
Luxoft is seeking a data-focused developer in Wrocław, Poland, to join their technology team. The role involves developing scalable web applications and building user interfaces using data from various APIs. Applicants should possess strong SQL, Python skills, and experience with cloud data platforms like AWS. Responsibilities ...
Poland, Wrocław
NEONTRI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Data Engineer (K/M) Miejsce pracy: Warszawa Technologie, których używamy Wymagane - SQL - GCP - Big Data - Data Warehouse - Data Lake - ETL/ELT - Feature Store - Customer 360 - Golden Record - CRM O projekcie Cześć! Z tej strony Neontri - jesteśmy firmą liczącą ponad 120 osób. Specjalizujemy się w dwóch obszarach: ...
Poland, Warszawa
WYMAGANIA: Minimum 4 lata doświadczenia na stanowisku Data Engineera lub w pokrewnej roli Bardzo dobra znajomość Python oraz SQL Doświadczenie w budowie i utrzymaniu pipeline’ów danych (ETL/ELT) Praktyczna znajomość pracy z danymi ustrukturyzowanymi i nieustrukturyzowanymi (transformacje, normalizacja, przygotowanie) Umiejętność ...
Poland, Warszawa
26880 - 31920 zł
... contract: B2B, long term cooperation Model of work: hybrid, 1 day per week work from office (Gdańsk/ Warsaw/ Łódź) Introduction & Summary We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, specifically focused on supporting corporate lending operations. The ideal candidate must be ...
Poland, Gdańsk
130 zł PLN - 160 zł PLN
130 - 160 zł / stawka godzinowa Forma współpracy: Kontrakt B2B z IT LeasingTeam. Długofalowy kontrakt z gwarancją rozwoju w zespole wybitnych ekspertów technicznych, Tryb pracy: W pełni zdalny Zasugerowane Stawka godzinowa Praca zdalna
Poland, Bydgoszcz
26880 - 28560 zł
... SQL and Snowflake. Good understanding of data modelling, ETL/ELT processes and data integration. Experience working with large datasets and designing scalable data pipelines. Knowledge of data quality, validation and monitoring practices. Familiarity with cloud-based data platforms and modern data engineering concepts. Experience ...
Poland, Warszawa
21000 - 28560 zł
... (at least C1 level). - Bachelor’s degree in technical or mathematical studies. Addepto is a leading AI consulting (https://jobeax.com/link/rOiEvBn3dZ9KkGj7 and data engineering (https://jobeax.com/link/cLdQJ7azj7GOWKYv company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering ...
Poland, Poznań
120 zł PLN / month
... scalable data pipelines, datasets, and data models. The primary focus is on enabling accurate process analysis and supporting continuous improvement through robust data engineering and efficient integration of multiple source systems. Data Engineer - Process Mining Requirements: 3 to 5 years of experience in similar position. ...
Poland, Kraków
200 zł PLN
... Proficiency in at least one programming language, preferably Python. Strong knowledge of AWS cloud services including S3, Glue, and Lambda. Solid understanding of databases and data processing pipelines. Hands-on experience with software engineering best practices. Familiarity with Generative AI technologies. Strong problem-solving ...
Poland, Warszawa
Accenture
... scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently. Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms). Collaborate with cross‑functional teams including data engineers, data ...
Poland, Warszawa
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset. Enjoy a flexible work environment, ...
Poland, Warszawa
50 € / stawka godzinowa
... Power BI across multiple data pillars. Migrate master reference tables into a central Master Data Management (MDM) system. Design and implement a comprehensive data quality framework throughout the data pipeline. Automate data delivery processes for manually loaded data sources. Migrate data sources to a full raw data model ...
Poland, Warszawa
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Katowice
$2k USD
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
Poland, Wrocław
$2k USD
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
Poland, Kraków
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Łódź
... - Proactive mindset with strong organizational and time-management skills. - Excellent command of English (at least C1 level). - Interest in developing as a Data Engineer. Discover our perks & benefits: - Work in a supportive team of passionate enthusiasts of AI & Big Data. - Engage with top-tier global enterprises and ...
Poland, Warszawa
TQLO SP. Z O.O.
20160 - 21840 zł
... obejmuje rozwój platformy danych, architektury analitycznej oraz rozwiązań wykorzystujących AI. Do realizacji projektu poszukiwana jest osoba do współpracy w roli Data Engineer, która posiada doświadczenie w projektowaniu i rozwijaniu nowoczesnych platform danych opartych o Google Cloud Platform oraz chce uczestniczyć w projektach ...
Poland, Warszawa