Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 130,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
... częściej,, budżet projektu: do 160 PLN/h + VAT, w zależności od doświadczenia oraz zakresu świadczonych usług. minimum 4 lata doświadczenia w realizacji usług w roli Data Engineer,, doświadczenie w projektowaniu i modelowaniu struktur danych na potrzeby hurtowni danych, Data Lake oraz rozwiązań Real-Time lub Near Real-Time,, doświadczenie ...
... Development: Cursor, Claude Code, ChatGPT Enterprise - Future direction: agentic AI systems, LangChain, Azure OpenAI integration What else you should know: - Team: Data Architecture Lead, Data Engineers, DataOps Engineers, Backend Engineer, Product Owner, collaboration with Frontend Engineers and Data Science and AI Engineers ...
... provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for: Data Engineer Offer: - Private medical care - Co-financing for the sports card - Constant support of dedicated consultant - Employee referral program ,[Working with ...
... Experience in data engineering, data science, or related field. Proficiency with data architecture and data processing tools. Certifications: Azure Associate Data Engineer (DP-203), Databricks Professional Data Engineer, Apache Spark Developer Associate, Professional Data Engineer. Experience with Power BI, DAX, and Tabular ...
Data Engineers (Mid & Senior) — Krakow (Hybrid) Are you looking to work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive ...
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
The Data Engineering team’s mission is to ensure high-quality data to enable data-informed decision-making across Asana. You will build data artifacts that are leveraged by a wide range of stakeholders in the marketing domain, and create frameworks and tooling used by all data and analytics engineering teams. In this role, ...
Konsultant wdrożeniowiec o profilu Data Engineer to specjalista, który łączy zaawansowane kompetencje techniczne z umiejętnością analizy danych i podstawową wiedzą z zakresu Data Science. Odpowiada za projektowanie, wdrażanie oraz utrzymanie nowoczesnych rozwiązań w obszarze Big Data, architektury danych i platform analitycznych, ...
... in Python. Requirements: Higher education in Computer Science, Mathematics / Statistics, Telecommunications or related. Ability to work with large amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing ...
... diverse sources, ensuring efficiency and scalability., Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment., Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and ...
... diverse sources, ensuring efficiency and scalability., Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment., Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and ...
... level). - Bachelor’s degree in technical or mathematical studies. Nice to have: - Experience with an MLOps framework such as Kubeflow or MLFlow. - Familiarity with Databricks, and/or dbt. Addepto is a leading AI consulting (https://jobeax.com/link/rOiEvBn3dZ9KkGj7 and data engineering (https://jobeax.com/link/cLdQJ7azj7GOWKYv ...
... we use Expected - SQL - Python About the project As a Senior Database Engineer, you will be responsible for designing, optimizing and scaling high-performance database infrastructure supporting millions of transactions and real-time data flows. You will work with transactional databases, document databases, Kafka-based streaming ...
... technical mentor for the team through pair programming, setting technical standards, and conducting code reviews. Minimum 5 years of commercial experience in data engineering with Google Cloud., Google Cloud Professional Data Engineer certification (expected or to be obtained within the first month of work)., Advanced knowledge ...
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
... building ETL processes and data pipelines for integrating data across various systems., Enabling reliable and secure data sharing between applications., Ensuring data quality, consistency, and high availability., Monitoring, troubleshooting, and optimizing pipeline performance., Collaborating closely with engineering and business ...
Senior Data Engineer Miejsce pracy: Gdańsk Technologies we use Expected - Databricks - Apache Spark - Python - PyTorch - Microsoft Azure Optional - Pytest About the project We are looking for a skilled Data Engineer to join an international technology and data team on a 6-month engagement, starting in the first or second ...
... Databricks, Delta Lake, Azure Data Factory, C#, Microsoft Azure Optional, Microsoft Power BI About the project, Senior Data Engineer role focused on end-to-end data engineering in modern cloud architectures, bridging business needs with technical solutions. Join agile product teams to manage MDM data products, optimize data flows, ...