Opis oferty
Poland, Warszawa
Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
Podobne oferty
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
Poland, Łódź
ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in ...
Poland, Katowice
Diverse CG Sp. z o.o. Sp.k.
Diverse CG Sp. z o.o. Sp.k. is looking for a Data Management Specialist in Poland, Województwo pomorskie. The role involves designing and building scalable BMC Helix data replication solutions while maintaining data architecture and developing data pipelines. Candidates should have a Master's degree in a related field, ...
Poland
A leading global consulting firm seeks an experienced Google Data Engineer in Wrocław. In this role, you will design, build, and maintain scalable data platforms on Google Cloud, working closely with analytics teams to ensure data quality and performance. The company offers a hybrid working model, access to extensive training ...
Poland, Wrocław
VirtusLab in Kraków is seeking a Software Engineer with Data & Quality to own the data quality domain within a key data processing platform. You will identify, analyze, and address data quality issues while designing offline solutions that do not impact production performance. The role blends data engineering, analytics, ...
Poland, Kraków
La Lorraine Bakery Group NV
5k - 5700
... are able to advise on and apply state-of-the‑art analytics, machine learning and optimisation techniques in a manufacturing context. - You are experienced in data engineering for manufacturing data and in preparing datasets for predictive modelling , including data cleaning, feature engineering and data enrichment . - You ...
Poland, Warząchewka Polska
14000 - 18500 zł
... business requirements into analytical solutions, improving reporting performance, and contributing to data governance. Position overview We are looking for a Data & Visualization Engineer with experience in Snowflake, SQL, data modeling, and BI tools. You will be involved in building data models, developing dashboards, ...
Poland, Wrocław
20000 - 30000 zł
Mid/Senior Cloud Data Engineer – GCP / Azure / BigQuery/ Snowflake 100% Remote B2B | Poland-based team Salary range: 20,000–30,000 PLN net + VAT / month ☁️ About Datumo Datumo is a Big Data & Cloud company specializing in data platforms, data engineering, cloud modernization and practical AI solutions. You do not need to ...
Poland, Warszawa
$2k USD
If you are an experienced Python Developer yearning to expand your skills in the data field, we present an extraordinary opportunity to scale up as a Data Software Engineer! You’ll broaden your skill set, enhance your career potential, and work with top trending technologies in a fascinating domain. This is a chance to ...
Poland, Łódź
$2k USD
If you are an experienced Python Developer yearning to expand your skills in the data field, we present an extraordinary opportunity to scale up as a Data Software Engineer! You’ll broaden your skill set, enhance your career potential, and work with top trending technologies in a fascinating domain. This is a chance to ...
Poland, Katowice
La Lorraine Bakery Group NV
... are able to advise on and apply state-of-the-art analytics, machine learning and optimisation techniques in a manufacturing context. - You are experienced in data engineering for manufacturing data and in preparing datasets for predictive modelling , including data cleaning, feature engineering and data enrichment . - You ...
Poland, Nowy Dwór Mazowiecki
amentis solutions GmbH sucht eine/n Data Scientist/ML Engineer, der oder die Kundendaten analysiert, ML-Modelle entwickelt und produktionsreife Services gestaltet. Du arbeitest an Data-Management, GenAI-Themen und Analytics in einem dynamischen Team. Du bringst fundierte Python-Kenntnisse, Erfahrung mit NLP/LLM-Architekturen ...
Poland, Warząchewka Polska
95 zł PLN - 118 zł PLN / hour
... Competence demands: - Proven experience as a Data Test Automation Engineer, Data QA Engineer, or similar role - Strong hands-on experience in ETL testing and data validation - Hands-on expertise of functional and non-functional testing in Azure Databricks, Azure Data Factory (ADF), SQL, and Python, with a focus on data ...
Poland, Wrocław
... these data. Experience of the standard data sources for subsurface data, Petrel & Studio, DISKOS etc. is an advantage. Key Responsibilities - Specify, develop data pipelines for subsurface and drilling data flows. - Build and maintain data products (for seismic, well data) on the data platform. - Align with teams supporting ...
Poland, Łódź
100 zł PLN - 140 zł PLN
... technologies in the data engineering space Wymagania Requirements Minimum 3 years of experience in a Data Engineer role or similar position Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience ...
Poland, Warszawa
Our client is seeking Software Engineers to design, build, and scale the foundational services powering their Agentic Data Plane (ADP) —a next-generation AI infrastructure that connects AI agents with enterprise data in real time. As a member of a newly formed Warsaw-based ADP team , you will collaborate with cloud and ...
Poland, Gdańsk
ISS World Services A/S
... solutions that have a real impact on both our customers and our people. Location: Porto, Portugal or Warsaw, Poland Work regime: Hybrid The Job Role as Platform Engineer (Analytics, Data & AI): We are seeking an experienced DevOps Engineer/IT Engineer with strong experience in Azure services to join our team. The ideal candidate ...
Poland, Warszawa
Virtus Lab Sp. z o.o. All trademarks their respective owners
... solutions that avoid impacting production performance. You’ll work with Kotlin/Java in a Spring Boot stack and collaborate with a US team, applying a proactive, ownership-driven approach. The role blends data engineering, analytics, and automation to improve data stability across a large data ecosystem, with emphasis on
Poland, Kielce
... Data Security engineering - Experience on Cloud Native solutions and Cloud based data structures on AWS, GCP, Azure and AliCloud - Experience with structured data, structured data security and database activity monitoring (DAM) - Python programming skills for automation, scripting, data processing, and cloud infrastructure ...
Poland, Kraków
... skilled QA Automation Engineer is sought to join a team focused on data engineering tasks. The ideal candidate will possess significant expertise in automation and data warehouse testing, particularly with the Snowflake platform. The role requires prompt results and the ability to adapt to ongoing data testing processes while ...
Poland, Gdańsk