... diverse sources, ensuring efficiency and scalability., Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment., Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and ...
... diverse sources, ensuring efficiency and scalability., Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment., Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and ...
... product development, agile, scrum Team members, technical leader, big data developer, data scientist, project manager Your responsibilities, Design scalable data processing pipelines for streaming and batch processing using Big Data technologies like Databricks, Airflow and/or Dagster., Contribute to the development of ...
Senior Data Engineer (Databricks & Python) Miejsce pracy: Warszawa Technologies we use Expected - Python - PySpark - Spark SQL - Delta Lake About the project We are looking for an experienced Senior Data Engineer to join our Labeling Data Platform team. The platform supports the collection, processing, transformation, governance, ...
... industry. You'll design and develop scalable cloud-based data platforms and explore the latest Generative AI and AI Agent solutions using Microsoft Azure and Databricks, collaborating with experienced engineers across multiple countries., , Technology Stack, Azure Databricks | Python | PySpark | SQL | Delta Lake | Terraform ...
... combines strong hands-on engineering capabilities with a deep understanding of modern Azure data platforms, Databricks Lakehouse architecture, and regulated data environments. This is how we work, at the client's site Your responsibilities, Develop and maintain data pipelines using Azure Databricks, Python, PySpark, Spark ...
... and non-functional business requirements 5+ years of experience or 5+ completed projects, Advanced SQL and query optimization, with proficiency across popular database variations, Python for data engineering and automation, Cloud data platforms: Snowflake and/or Databricks, Cloud services: AWS and/or Azure, Data transformation ...
... Twój zakres obowiązków, Platforma Databricks, •Pełnienie roli Tech Leada dla rozwoju platformy Databricks Lakehouse., •Wsparcie zespołów w budowie produktów dataowych (best practices, wzorce, narzędzia)., •Projektowanie warstw abstrakcji i frameworków upraszczających pracę developerów., •Rozwój platformy zgodnie z podejściem ...
... scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently. Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms). Collaborate with cross‑functional teams including data engineers, data ...
Expected, Python, Microsoft Azure, SQL, Git Your responsibilities, We are looking for a Senior Data Engineer to join a team responsible for maintenance and development of treasury applications. Databricks, Python, Azue Data Factory, logic apps and azure functions, High SQL and SQL optimization skills, GIT repo management ...
Senior Data Engineer (Databricks, Azure Data Factory) Miejsce pracy: Wrocław Technologies we use Expected - Python - Microsoft Azure - SQL - Git Your responsibilities We are looking for a Senior Data Engineer to join a team responsible for maintenance and development of treasury applications. Our requirements - Databricks ...
Azure Data Engineer with Databricks (AI&Data) Miejsce pracy: Warszawa Technologies we use Expected - Databricks - Azure DevOps - SQL - Python - AWS Optional - Tableau - Microsoft Power BI Your responsibilities - Develop and implement scalable data processing solutions on Azure, transforming and cleaning large structured ...
... technologies in the data engineering space Wymagania Requirements Minimum 3 years of experience in a Data Engineer role or similar position Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience ...
... contracts, loyalty programmes and flight schedules. As part of our modernization journey, we are migrating from Teradata to Databricks and building a modern, scalable data platform. This role offers the opportunity to influence architectural decisions, shape future data solutions and work with complex data ecosystems in an international ...
Databricks Engineer Miejsce pracy: Warszawa Technologies we use Expected - Databricks - Microsoft Azure - Python - SQL - Apache Spark Optional - Apache Hive - Impala About the project We are looking for a Mid/Senior Databricks Engineer to design and develop scalable data processing and integration solutions within an Azure ...
... with Azure Data Factory (ADF) pipelines proficiency in incremental and full data loads familiarity with CI/CD integration for data workflows knowledge of Databricks and Python for advanced data processing strong grasp of dimensional modeling and schema design experience implementing Change Data Capture (CDC) in production ...
Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric Miejsce pracy: Warszawa Technologies we use Expected - Python - SQL - Azure DevOps Optional - Azure DevOps About the project The project migrates data and reporting from a legacy estate onto a modern platform built on Databricks and Microsoft Fabric. ...
... one of the aviation industry's largest data warehouses. You will shape architecture, migrate from Teradata to Databricks, and work with complex, international data ecosystems in an agile, collaborative environment. The role requires 5+ years in data engineering/architecture, strong SQL, Databricks and PySpark experience, ...
... Microsoft i Databricks, jednocześnie stale rozwijamy się i poszukujemy nowych sposobów, by zaspokoić wymagania rynku. Aktualnie poszukujemy doświadczonego Databricks Tech Lead, który będzie kluczowym członkiem naszego zespołu, odpowiedzialnym za projektowanie i rozwój rozwiązań opartych o platformę Databricks, nadzorowanie ...