Wróć do listy

Opis oferty

Senior Data Engineer (Azure, Databricks) w Wrocław, Polska

OPTIVEUM SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

  • ZdalniePraca z dowolnego miejsca
  • HybrydowoPołączenie biura i pracy zdalnej
  • StacjonarniePraca z biura
  • KontraktUmowa czasowa lub freelancing

165 zł

Wrocław, Polska

Your responsibilities

  • Extract, combine, transform, load and cleanse data from various sources to deliver high-quality datasets for analysis, including migration from legacy systems
  • Work with data modellers and business analysts to understand the data model and source-to-staging mapping
  • Create analysis-ready data structures, including DDLs for MS Cloud SQL Server tables and views in the Pond database (a subset of the Data Lake)
  • Design and develop Databricks notebooks that extract data from input files and join related entities into Shared File Formats (SFFs)
  • Configure Ingestion Framework tables to load staging and Data Lake Core (DLC) tables
  • Build large-scale batch and real-time data pipelines in cloud or on-premises environments and develop performance-efficient algorithms
  • Apply CI/CD best practices and introduce automation in existing and future integration flows
  • Track data consumption patterns and work with data governance and information stewards on the curated data catalogue
  • Drive improvements in data acquisition, testing and tooling to raise data quality
  • Monitor performance and optimise SQL queries
  • Prepare detailed design documents based on business and system requirement documents
  • Work in cross-functional agile teams and take part in requirement analysis and estimates

Our requirements

  • 5+ years of experience in data engineering or a related field, with a strong focus on ETL and cloud data tools
  • Bachelor's degree in Computer Science, Engineering or a related field (Master's preferred)
  • Certifications: Microsoft Certified Azure Data Engineer and Databricks Certified Data Engineer
  • Proficiency in Python, Java or Scala
  • Hands-on experience with MS Cloud SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, Power BI, SSIS and SSRS
  • Strong SQL skills and experience with relational databases
  • Familiarity with big data technologies and data processing frameworks
  • Experience with Agile/Scrum
  • Strong problem-solving and communication skills and a collaborative mindset
  • English at C1 level

Optional

  • Experience in financial services, ideally in a captive finance company, including customer, dealer and supplier data
  • Experience delivering global data marts used across regions
  • Java

Podobne oferty

Więcej podobnych stanowisk

Atos Poland Global Services Sp. z o.o.

Senior Data Engineer / Technical Lead (Azure Databricks)

  • Zdalnie

67k / year

... for a highly experienced Senior Data Engineer / Technical Lead to take ownership of the architecture, design, and technical direction of a modern enterprise data platform built on Azure Databricks. This role will serve as the technical right-hand to the engineering leadership team, providing technical guidance to a team ...

Warszawa, Polska

OPTIVEUM SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Azure Databricks Engineer

  • Hybrydowo
  • Pełny etat
  • Kontrakt

135 - 160 zł / stawka godzinowa

... higher in Computer Science, Engineering or Science, 8–10 years of experience, including 5+ years with Azure cloud-native services, Strong hands-on experience with Azure Databricks, Delta Lake, Python / PySpark and Spark, Knowledge of Lakehouse, Data Mesh, Data Virtualisation, dimensional modelling and data aggregation techniques, ...

Kraków, Polska

  • Zdalnie
  • Zarzadzanie projektami
  • Data Science
Expected, Python, Databricks, SQL, Microsoft Azure, DevOps Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...

Warszawa, Polska

  • Zdalnie
  • Hybrydowo

€22.5 EUR

... consistency, security, and scalability within cloud-based environments. Your Profile - Strong experience in data engineering, with at least 1 year of hands-on Databricks expertise. - Strong experience in Python for automation and data transformation. - Experience working with at least one major cloud platform (AWS, Azure, or ...

Warszawa, Polska

  • Zdalnie
  • Kontrakt

38 € / stawka godzinowa

Senior Databricks Data Engineer Location: 100% Remote (Poland) Rate: up to 38 EUR + VAT (B2B) Work model: B2B Contract Contracting Party: Optiveum Optiveum is currently looking for a Senior Databricks Data Engineer to join the team of our client—a thriving technology organization with over 400 professionals dedicated to ...

Warszawa, Polska

  • Zdalnie
  • Zarzadzanie projektami
  • Data Science
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects ...

Warszawa, Polska

  • Zdalnie
  • Hybrydowo
  • Pełny etat
  • Kontrakt

120 - 130 zł / stawka godzinowa

Databricks Data Engineer Miejsce pracy: Wrocław Technologies we use Expected - Python - SQL - PySpark - Microsoft Azure - Git - Azure DevOps - Azure Databricks - Azure Data Factory Optional - Kafka - Event Hub - Microsoft Power BI - Tableau Operating system - Windows About the project In Cyclad we work with top international ...

Wrocław, Polska

IT CONNECT Sp. z o.o. Sp. k.

Databricks Data Engineer

145 zł / stawka godzinowa

... practices in data engineering., Ensure data consistency, security, and scalability within cloud-based environments. Experience in data engineering, with hands-on Databricks expertise., Strong experience in Python for automation and data transformation., Experience working with at least one major cloud platform (AWS, Azure, ...

Poznań, Polska

  • Zdalnie

21000 - 25000 zł

- 4+ years of experience in Big Data or Data Engineering - Strong proficiency in Python (PySpark) and SQL - Hands-on experience with AWS cloud services for data engineering solutions - Practical experience with Databricks on AWS , including building and managing data pipelines - Strong knowledge of Apache Spark and large-scale ...

Polska

REMODEVS SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Senior Data Engineer (Databricks) - Financial Services

  • Data Science

24000 - 29000 zł

Expected, Databricks, Apache Spark, PyTorch, Python, SQL Optional, Azure DevOps, Unity 3D, Azure SQL About the project, We are looking for an experienced Senior Data Engineer to join a long-term project for a client in the financial services industry. The ideal candidate has strong hands-on experience with Databricks, modern ...

Warszawa, Polska

  • Zdalnie
  • Hybrydowo

18700 - 22500 zł

... applying data engineering methods within the cybersecurity domain., Proven ability to design, build, and maintain data pipelines and ETL workflows across disparate datasets., Experience with Azure Data Factory, Azure Databricks, Azure Functions, Azure Logic Apps, Azure Monitor, Azure Log Analytics, Azure Data Lake Store, S3, ...

Kraków, Polska