Data Engineer w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering delivery. Conduct data profiling and quality assessments. Define acceptance criteria for data transformation. Collaborate with the programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta Lake (schema evolution, MERGE, time travel). Advanced SQL skills (complex queries, window functions); ability to comprehend legacy ETL. Familiarity with Databricks Asset Bundles (DAB) and CI/CD practices (Azure DevOps, Git). Working knowledge of Azure Data Lake Storage Gen2. Comfortable understanding legacy ETL processes and source data profiling. Experience with data reconciliation (defining criteria, interpreting discrepancies). Ability to articulate requirements for junior engineers. Fundamental knowledge of Power BI / Tableau. Nice to Have: Experience in platform engineering and configuration refactoring using YAML. Ability to maintain environment governance across DEV, QAS, and PRD. Skills in source feasibility analysis for new data sources. Capability in transformation development across various data zones using PySpark and Delta Lake. Familiar with implementing acceptance criteria and conducting quality checks. Other Details: This position is part of a complex and dynamic migration programme and is pivotal for ensuring the successful transition of data systems. Remote engagement options are available, and collaboration with an internal team is essential.
... Development: Cursor, Claude Code, ChatGPT Enterprise - Future direction: agentic AI systems, LangChain, Azure OpenAI integration What else you should know: - Team: Data Architecture Lead, Data Engineers, DataOps Engineers, Backend Engineer, Product Owner, collaboration with Frontend Engineers and Data Science and AI Engineers ...
... provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for: Data Engineer Offer: - Private medical care - Co-financing for the sports card - Constant support of dedicated consultant - Employee referral program ,[Working with ...
... Experience in data engineering, data science, or related field. Proficiency with data architecture and data processing tools. Certifications: Azure Associate Data Engineer (DP-203), Databricks Professional Data Engineer, Apache Spark Developer Associate, Professional Data Engineer. Experience with Power BI, DAX, and Tabular ...
Data Engineers (Mid & Senior) — Krakow (Hybrid) Are you looking to work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive ...
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
The Data Engineering team’s mission is to ensure high-quality data to enable data-informed decision-making across Asana. You will build data artifacts that are leveraged by a wide range of stakeholders in the marketing domain, and create frameworks and tooling used by all data and analytics engineering teams. In this role, ...
Konsultant wdrożeniowiec o profilu Data Engineer to specjalista, który łączy zaawansowane kompetencje techniczne z umiejętnością analizy danych i podstawową wiedzą z zakresu Data Science. Odpowiada za projektowanie, wdrażanie oraz utrzymanie nowoczesnych rozwiązań w obszarze Big Data, architektury danych i platform analitycznych, ...
... in Python. Requirements: Higher education in Computer Science, Mathematics / Statistics, Telecommunications or related. Ability to work with large amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing ...
... diverse sources, ensuring efficiency and scalability., Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment., Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and ...
... level). - Bachelor’s degree in technical or mathematical studies. Nice to have: - Experience with an MLOps framework such as Kubeflow or MLFlow. - Familiarity with Databricks, and/or dbt. Addepto is a leading AI consulting (https://jobeax.com/link/rOiEvBn3dZ9KkGj7 and data engineering (https://jobeax.com/link/cLdQJ7azj7GOWKYv ...
... from architecture to deployment, collaborating with a modern, high‑performing engineering team. What makes you a great fit: - 5+ years of professional data engineering experience - 2+ years working with programmatic advertising or ad-tech data - Strong proficiency in Python and SQL - Experience with streaming data platforms ...
... migrating the Pricing team to a new target data platform. Work with technical teams on data architecture decisions. Key Requirements Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing. Experience working with SQL and Python for data ingestion, ...
... windowing, segmentacja) i struktur danych zoptymalizowanych dla tysięcy eventów na sekundę Zbieranie, analiza i synteza wymagań od zespołów produktowych, analityków i Data Science. Propagowanie kultury data-driven w organizacji Tworzenie dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania ...
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
... build a more sustainable, more inclusive world. Your Team Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across platforms ...
... Are a Good Candidate If You Have - 7-10 years of experience in data engineering, platform development, and/or large-scale data systems - Proven leadership of engineering teams - Strong hands-on knowledge of modern data platforms such as Databricks - Experience with data pipeline orchestration, data modeling, data quality ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...