Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
IN4GE sp. z o.o.
... umożliwiająca swobodną komunikację pisemną i ustną (codzienna współpraca z klientami anglojęzycznymi)., Mocne podstawy software engineering (preferowane nad czysto data/BI profile), Doświadczenie z:, a) platformami lakehouse (Databricks),, b) architekturą streamingową / near real-time,, c) Databricks Structured Streaming, Delta ...
Poland, Warszawa
... join a project focused on building a modern reporting and data platform. You will work with multiple data sources and systems, integrating them into a central data warehouse and enabling business teams to access data via Power BI. The role requires 5+ years in Data Engineering, strong SQL and data warehouse skills, and hands-on ...
Poland, Warząchewka Polska
ERGO Technology & Services
... need fluent English (C1) university degree in the field of Computer Science, Information Systems Management, Business Informatics, Mathematics, Industrial Engineering, or a comparable education experience in one of the common programming languages e.g. Python, Java, C++ and familiar with database technologies like SQL ...
Poland, Warszawa
Incubly is seeking a Software Engineer – Full Stack, Mobile & Data to join an R&D project spanning Android, web, backend, data processing, ML and AWS infrastructure. You will work across the full software lifecycle from requirements to deployment, delivering robust, scalable solutions. The role requires strong fundamentals ...
Poland, Łódź
Nordea seeks an IT Developer/Data Engineer to advance data engineering for Capital and Credit Data Foundation. The role focuses on building scalable ELT/ETL pipelines, optimizing SQL/PLSQL, and implementing CI/CD for data infrastructure. Work spans on-prem and cloud in a hybrid environment across Poland and Finland. You ...
Poland, Gdynia
Phoenix Court Group
Phoenix Court Group is looking for an experienced software engineer specializing in large-scale data processing systems. You will be responsible for designing systems that handle billions of requests daily, improving application efficiency and scalability. With a minimum of 8 years’ experience in software development, proficiency ...
Poland, Kraków
$2k USD
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
Poland, Warszawa
IG KnowHow is seeking a Senior Data Engineer based in Kraków, Poland. In this role, you will design and build robust data pipelines on GCP, ensuring data quality and integrity. You will work collaboratively within a hybrid model, balancing office presence and remote work. The ideal candidate will have proven experience ...
Poland, Kraków
Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models. Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming ...
Poland, Poznań
... optimization, IT systems design, implementation, maintenance, and business application development. We are looking for a Senior Data & AI Engineer who combines strong data engineering skills with a customer-oriented and advisory mindset . In this role, you’ll work closely with our customers to understand their business and data ...
Poland, Warząchewka Polska
$2k USD
... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...
Poland, Katowice
We are looking for an experienced Data Engineer with Microsoft Fabric to join our Data & Analytics Competence Center – a specialized unit bringing together top experts in data engineering, data processing, analytics, and cloud technologies. This role is dedicated to implementation projects based on Microsoft Fabric, where ...
Poland, Gdańsk
We are looking for an experienced Senior Data Engineer to join a data team working on global data platforms within the financial services domain. You will be part of a large-scale transformation initiative aimed at building a modern, cloud-based data ecosystem and enabling the organization to become fully data-driven. The ...
Poland, Wrocław
... experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using ...
Poland, Warszawa
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
Poland, Łódź
ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in ...
Poland, Katowice
A leading global consulting firm seeks an experienced Google Data Engineer in Wrocław. In this role, you will design, build, and maintain scalable data platforms on Google Cloud, working closely with analytics teams to ensure data quality and performance. The company offers a hybrid working model, access to extensive training ...
Poland, Wrocław
VirtusLab in Kraków is seeking a Software Engineer with Data & Quality to own the data quality domain within a key data processing platform. You will identify, analyze, and address data quality issues while designing offline solutions that do not impact production performance. The role blends data engineering, analytics, ...
Poland, Kraków
La Lorraine Bakery Group NV
5k - 5700
... are able to advise on and apply state-of-the‑art analytics, machine learning and optimisation techniques in a manufacturing context. - You are experienced in data engineering for manufacturing data and in preparing datasets for predictive modelling , including data cleaning, feature engineering and data enrichment . - You ...
Poland, Warząchewka Polska
14000 - 18500 zł
... business requirements into analytical solutions, improving reporting performance, and contributing to data governance. Position overview We are looking for a Data & Visualization Engineer with experience in Snowflake, SQL, data modeling, and BI tools. You will be involved in building data models, developing dashboards, ...
Poland, Wrocław