Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
ASTEK Polska Sp. z o.o.
Astek Polska sp. z o.o. poszukuje Data Engineera do pracy nad projektami dla sektora farmaceutycznego w Warszawie. Rola obejmuje projektowanie i rozwijanie skalowalnych architektur danych, tworzenie hurtowni danych i Data Lake, a także implementację złożonych procesów ETL/ELT w środowisku AWS. Wymagana jest praktyczna wiedza ...
Poland, Warszawa
ERGO Technology & Services
... maintaining ETL processes to integrate data from diverse sources, including market data feeds, customer information systems, and transactional databases ensuring data quality, security, and compliance with regulatory requirements collaborating with business owners, data analysts and scientists, software engineers, and DevOps ...
Poland, Warszawa
Work flexibility - hybrid working model, flexible start of the day, sabbatical leave, Senior Data Engineer in FCU Technology Team (remote) Język polski Praca hybrydowa Praca zdalna Elastyczne godziny
Poland
180 zł PLN - 500 zł PLN / hour
Working as a Senior AWS Data Engineer you will: Design and build robust data ingestion pipelines leveraging SP-API and Data Kiosk. Lead the seamless integration and complex mapping of SAP data into the central cloud ecosystem. Develop, optimize, and maintain highly efficient ETL/ELT workflows using AWS Glue. Implement and ...
Poland, Warszawa
... documentation and best practices. - Stay curious about emerging Databricks features and industry trends to drive continuous improvement. To be a good fit for the Senior Data Engineer Role, you will have: - 4+ years of hands‑on experience in data engineering, data transformation, or analytics engineering. - Strong proficiency in Python ...
Poland, Warząchewka Polska
$2k USD
We are looking for a Senior Data Software Engineer to join our growing Data Practice and make our team even stronger. Our projects and technologies are very diverse and cover all technologies currently on the market and represented by open-source communities. We are providing our service to Clients in different domains: ...
Poland, Kraków
... evolve the foundation that powers data-driven decision-making across Arla? In Data Foundation, we are responsible for delivering and evolving the core Azure Databricks data platform and infrastructure that enables analytics, reporting and AI solutions across Arla. As an Experienced Data Platform Engineer, you will play ...
Poland, Gdańsk
19015 - 20916 zł
... revenue impact and collaborate with some of the world’s largest AI companies. Responsibilities: Work with the business development (BD) team, content experts, data science, and engineering teams to understand customer requirements and available metadata. Map customer requirements to our existing metadata and apply data modelling ...
Poland, Kraków
IN4GE sp. z o.o.
... umożliwiająca swobodną komunikację pisemną i ustną (codzienna współpraca z klientami anglojęzycznymi)., Mocne podstawy software engineering (preferowane nad czysto data/BI profile), Doświadczenie z:, a) platformami lakehouse (Databricks),, b) architekturą streamingową / near real-time,, c) Databricks Structured Streaming, Delta ...
Poland, Warszawa
... join a project focused on building a modern reporting and data platform. You will work with multiple data sources and systems, integrating them into a central data warehouse and enabling business teams to access data via Power BI. The role requires 5+ years in Data Engineering, strong SQL and data warehouse skills, and hands-on ...
Poland, Warząchewka Polska
ERGO Technology & Services
... need fluent English (C1) university degree in the field of Computer Science, Information Systems Management, Business Informatics, Mathematics, Industrial Engineering, or a comparable education experience in one of the common programming languages e.g. Python, Java, C++ and familiar with database technologies like SQL ...
Poland, Warszawa
Incubly is seeking a Software Engineer – Full Stack, Mobile & Data to join an R&D project spanning Android, web, backend, data processing, ML and AWS infrastructure. You will work across the full software lifecycle from requirements to deployment, delivering robust, scalable solutions. The role requires strong fundamentals ...
Poland, Łódź
Nordea seeks an IT Developer/Data Engineer to advance data engineering for Capital and Credit Data Foundation. The role focuses on building scalable ELT/ETL pipelines, optimizing SQL/PLSQL, and implementing CI/CD for data infrastructure. Work spans on-prem and cloud in a hybrid environment across Poland and Finland. You ...
Poland, Gdynia
Phoenix Court Group
Phoenix Court Group is looking for an experienced software engineer specializing in large-scale data processing systems. You will be responsible for designing systems that handle billions of requests daily, improving application efficiency and scalability. With a minimum of 8 years’ experience in software development, proficiency ...
Poland, Kraków
$2k USD
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
Poland, Warszawa
IG KnowHow is seeking a Senior Data Engineer based in Kraków, Poland. In this role, you will design and build robust data pipelines on GCP, ensuring data quality and integrity. You will work collaboratively within a hybrid model, balancing office presence and remote work. The ideal candidate will have proven experience ...
Poland, Kraków
Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models. Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming ...
Poland, Poznań
18480 - 26880 zł
Responsibilities As a Data Science Engineer, you will develop data-driven solutions on AWS — combining data analysis, feature engineering, statistical thinking, and hands-on data engineering. You will work closely with business, engineering, and platform teams to turn data into actionable insights and scalable analytical ...
Poland, Katowice
... optimization, IT systems design, implementation, maintenance, and business application development. We are looking for a Senior Data & AI Engineer who combines strong data engineering skills with a customer-oriented and advisory mindset . In this role, you’ll work closely with our customers to understand their business and data ...
Poland, Warząchewka Polska
$2k USD
... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...
Poland, Katowice