... scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently. Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms). Collaborate with cross‑functional teams including data engineers, data ...
... experience with Azure Data Factory (ADF) pipelines proficiency in incremental and full data loads familiarity with CI/CD integration for data workflows knowledge of Databricks and Python for advanced data processing strong grasp of dimensional modeling and schema design experience implementing Change Data Capture (CDC) in production ...
... technologies in the data engineering space Wymagania Requirements Minimum 3 years of experience in a Data Engineer role or similar position Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience ...
... trusted, governed data required for accurate responses. With over 150 Databricks projects delivered, we unlock self-service analytics for Fortune 500 leaders. Databricks invested in us because of our technical excellence, placing us in the "inner circle" of the ecosystem. For our engineers, this means direct access to product ...
... one of the aviation industry's largest data warehouses. You will shape architecture, migrate from Teradata to Databricks, and work with complex, international data ecosystems in an agile, collaborative environment. The role requires 5+ years in data engineering/architecture, strong SQL, Databricks and PySpark experience, ...
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering ...
... Experience in data engineering, data science, or related field. Proficiency with data architecture and data processing tools. Certifications: Azure Associate Data Engineer (DP-203), Databricks Professional Data Engineer, Apache Spark Developer Associate, Professional Data Engineer. Experience with Power BI, DAX, and Tabular ...
... What you’ll achieve Design, implement and scale end-to-end data products that support growing data processing and analytical needs. Influence best practices in Databricks and cloud-based data engineering, driving innovation and adoption across teams. Leverage AI to build self-serve tools and accelerate Data/GTM workflows. ...
... min. B2+ , - stawka do 170 zł/h przy B2B w zależności od doświadczenia. Ta oferta jest dla Ciebie, jeśli: - posiadasz doświadczenie komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, ...
... Are a Good Candidate If You Have - 7-10 years of experience in data engineering, platform development, and/or large-scale data systems - Proven leadership of engineering teams - Strong hands-on knowledge of modern data platforms such as Databricks - Experience with data pipeline orchestration, data modeling, data quality ...
Konsultant wdrożeniowiec o profilu Data Engineer to specjalista, który łączy zaawansowane kompetencje techniczne z umiejętnością analizy danych i podstawową wiedzą z zakresu Data Science. Odpowiada za projektowanie, wdrażanie oraz utrzymanie nowoczesnych rozwiązań w obszarze Big Data, architektury danych i platform analitycznych, ...
... Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve large-scale Big Data and cloud-native platforms for global clients, including ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
... Competence demands: - Proven experience as a Data Test Automation Engineer, Data QA Engineer, or similar role - Strong hands-on experience in ETL testing and data validation - Hands-on expertise of functional and non-functional testing in Azure Databricks, Azure Data Factory (ADF), SQL, and Python, with a focus on data ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
... smart infotainment and unlocks data-driven solutions for car maintenance and anomaly detection across the organization. - Design and development of a universal data platform for global aerospace companies. This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is ...
... documentation and best practices. - Stay curious about emerging Databricks features and industry trends to drive continuous improvement. To be a good fit for the Senior Data Engineer Role, you will have: - 4+ years of hands‑on experience in data engineering, data transformation, or analytics engineering. - Strong proficiency in Python ...
... This project addressed critical data management challenges, boosting user adoption, performance, and data integrity. The team is implementing a comprehensive data catalog, leveraging Databricks and Apache Spark/PySpark, for simplified data access and governance. Secure integration solutions and enhanced data quality monitoring, ...
... evolve the foundation that powers data-driven decision-making across Arla? In Data Foundation, we are responsible for delivering and evolving the core Azure Databricks data platform and infrastructure that enables analytics, reporting and AI solutions across Arla. As an Experienced Data Platform Engineer, you will play ...