Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
Accenture
... scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently. Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms). Collaborate with cross‑functional teams including data engineers, data ...
Poland, Warszawa
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset. Enjoy a flexible work environment, ...
Poland, Warszawa
50 € / stawka godzinowa
... Power BI across multiple data pillars. Migrate master reference tables into a central Master Data Management (MDM) system. Design and implement a comprehensive data quality framework throughout the data pipeline. Automate data delivery processes for manually loaded data sources. Migrate data sources to a full raw data model ...
Poland, Warszawa
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Katowice
$2k USD
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
Poland, Wrocław
$2k USD
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
Poland, Kraków
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Łódź
... - Proactive mindset with strong organizational and time-management skills. - Excellent command of English (at least C1 level). - Interest in developing as a Data Engineer. Discover our perks & benefits: - Work in a supportive team of passionate enthusiasts of AI & Big Data. - Engage with top-tier global enterprises and ...
Poland, Warszawa
TQLO SP. Z O.O.
20160 - 21840 zł
... obejmuje rozwój platformy danych, architektury analitycznej oraz rozwiązań wykorzystujących AI. Do realizacji projektu poszukiwana jest osoba do współpracy w roli Data Engineer, która posiada doświadczenie w projektowaniu i rozwijaniu nowoczesnych platform danych opartych o Google Cloud Platform oraz chce uczestniczyć w projektach ...
Poland, Warszawa
Sii Poland is seeking an experienced Senior Data Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based ...
Poland, Rzeszów
Sii is seeking an experienced Senior Data Engineer to join a pharmaceutical project. You will design, develop, and maintain scalable data platforms that support advanced analytics and business decision-making across markets worldwide. This role contributes to a modern data platform used across diverse teams and environments, ...
Poland
ASTEK Polska Sp. z o.o.
Astek Polska sp. z o.o. poszukuje Data Engineera do pracy nad projektami dla sektora farmaceutycznego w Warszawie. Rola obejmuje projektowanie i rozwijanie skalowalnych architektur danych, tworzenie hurtowni danych i Data Lake, a także implementację złożonych procesów ETL/ELT w środowisku AWS. Wymagana jest praktyczna wiedza ...
Poland, Warszawa
Smarketer Group Sp. z o.o.
... code’u, kawa / herbata, napoje, dofinansowanie wypoczynku, świętowanie urodzin, program rekomendacji pracowników, dodatkowy urlop Twój wkład, Jako Senior Data Engineer będziesz rozwijać i optymalizować skalowalne potoki danych, platformy danych oraz agentowe procesy w całym cyklu życia inżynierii danych., , Twoim celem ...
Poland, Szczecin
Work flexibility - hybrid working model, flexible start of the day, sabbatical leave, Senior Data Engineer in FCU Technology Team (remote) Język polski Praca hybrydowa Praca zdalna Elastyczne godziny
Poland
180 zł PLN - 500 zł PLN / hour
Working as a Senior AWS Data Engineer you will: Design and build robust data ingestion pipelines leveraging SP-API and Data Kiosk. Lead the seamless integration and complex mapping of SAP data into the central cloud ecosystem. Develop, optimize, and maintain highly efficient ETL/ELT workflows using AWS Glue. Implement and ...
Poland, Warszawa
... documentation and best practices. - Stay curious about emerging Databricks features and industry trends to drive continuous improvement. To be a good fit for the Senior Data Engineer Role, you will have: - 4+ years of hands‑on experience in data engineering, data transformation, or analytics engineering. - Strong proficiency in Python ...
Poland, Warząchewka Polska
ERGO Technology & Services
... maintaining ETL processes to integrate data from diverse sources, including market data feeds, customer information systems, and transactional databases ensuring data quality, security, and compliance with regulatory requirements collaborating with business owners, data analysts and scientists, software engineers, and DevOps ...
Poland, Warszawa
DataArt Poland sp. z o.o.
14000 - 16700 zł
Senior Data QAA Engineer Miejsce pracy: Warszawa Technologies we use Expected - Databricks - Python - SQL - Pytest - Jenkins - GitHub Actions - Git - AWS - Svelte Optional - Apache Spark - Apache Flink About the project an international platform for ticket sales tools: mobile app, responsive web application, call center ...
Poland, Warszawa
$2k USD
We are looking for a Senior Data Software Engineer to join our growing Data Practice and make our team even stronger. Our projects and technologies are very diverse and cover all technologies currently on the market and represented by open-source communities. We are providing our service to Clients in different domains: ...
Poland, Kraków
... evolve the foundation that powers data-driven decision-making across Arla? In Data Foundation, we are responsible for delivering and evolving the core Azure Databricks data platform and infrastructure that enables analytics, reporting and AI solutions across Arla. As an Experienced Data Platform Engineer, you will play ...
Poland, Gdańsk