Expected, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Databricks, Apache Spark, SQL, Delta Lake

Optional, Python, Scala, Java, Azure DevOps, Azure Event Hubs, Kafka, Azure Pureview

About the project, We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients.

This is how we work, in house, you have influence on the choice of tools and technologies, you have influence on the technological solutions applied, you have influence on the product

Your responsibilities, Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks, Develop and optimize ETL processes using Azure Data Factory and Databricks, Build Big Data solutions aligned with business requirements, Collaborate with Data Science, BI, and development teams to ensure high-quality data, Monitor performance of data processing systems and implement improvements, Implement data security standards and practices, Research and evaluate new technologies in the data engineering space

Minimum 3 years of experience in a Data Engineer role or similar position, Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake), Extensive experience with Databricks and Apache Spark, Proficiency in SQL and experience with relational databases, Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments, Strong programming skills in Python, Scala, or Java, Experience with Delta Lake architecture and optimization techniques, Knowledge of data modeling and schema design

Optional, Experience with Azure DevOps and CI/CD pipelines for data solutions, Knowledge of Databricks Delta Live Tables and Databricks workflows, Experience with real-time data processing using Azure Event Hubs or Kafka, Familiarity with Azure Purview or other data governance tools, Databricks or Azure certifications

What we offer, Salary: 100 - 140 zł/h+ VAT (B2B contract), Co-financing for training and certifications, as well as guaranteed time for learning during working hours, Private medical care and a Multisport card, Language classes (English), Flexible working hours, Team integration meetings and company events, Employee referral program with a bonus, An individually tailored career development path

Recruitment stages, Recruitment Interview

DEVAPO SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ, At Devapo, we focus on continuous self-development and acquiring new knowledge. If you are a fast learner, want to participate in international projects, are a team player, and can work independently — join us!, , We provide our clients with more than just code — we want to equip them with tools that allow their businesses to flourish. Our clients’ success is our success, which is why we ensure that everyone who creates Devapo has a long-term goal in mind.

This is how we work,

Databricks Data Engineer

Zacznij od adresu e-mail