We are looking for a skilled Data Engineer to join an international technology and data team on a 6-month engagement, starting in the first or second week of October.
This is a hands-on role focused on building data solutions for the insurance domain. You will use Databricks AI capabilities and Apache Spark to extract, process and structure information from both typed and handwritten insurance documents. A key part of the role will be transforming and modelling this data so it can be reliably used for machine learning and analytics use cases. You will be working 100% remotely in international team.
This is how we organize our work
This is how we work
you focus on a single project at a time
you have influence on the technological solutions applied
you focus on product development
agile
Team members
backend developer
technical leader
data scientist
product owner
Your responsibilities
Design and develop scalable data pipelines using Azure, Databricks, Python and PySpark.
Use Databricks AI tooling and Spark-based processing to extract and process data from typed and handwritten insurance documentation.
Clean, validate, transform and model data for machine learning, analytics and BI use cases.
Build reliable datasets that can support downstream reporting, analytical models and AI/ML solutions.
Develop and maintain data transformations using Python and PySpark.
Support end-to-end data engineering and analytics initiatives, from data ingestion through processing, quality validation and delivery.
Apply clean-code principles, write maintainable and well-documented code, and contribute to code reviews.
Create and maintain unit tests to ensure the quality, reliability and stability of data pipelines.
Collaborate with data, analytics and business stakeholders to understand requirements and translate them into practical technical solutions.
Identify data-quality issues and contribute to improvements in data governance, consistency and usability.
Our requirements
Commercial experience as a Data Engineer or in a similar data-focused technical role.
Strong hands-on experience with Microsoft Azure and Databricks.
Very good knowledge of Python and practical experience with PySpark.
Experience building and maintaining data pipelines using Apache Spark and Databricks.
Experience extracting, processing, cleansing and transforming structured and unstructured or semi-structured data.
Understanding of data modelling principles and the ability to prepare data for machine learning, advanced analytics and BI/reporting use cases.
Experience writing unit tests and validating data pipeline logic.
Strong focus on clean code, code quality, maintainability and technical documentation.
Fluent English at least B2
Availability to start in the first or second week of October - must have
Availability for a 6-month contract.
What we offer
Project for 6 months - possible to extend
This is how we work on a project
Clean Code
code review
Continuous Integration
documentation
test automation
unit tests
Benefits
remote work opportunities
Recruitment stages
Online meeting or phone call with Recruiter (20-30 min.)
Technical verification call focused on your experience and project requirements
Technical interview with the client, including practical questions and potentially live coding or a technical task
... for an experienced Senior Data Engineer to join a cross-functional Agile team within the banking domain. The role focuses on designing and improving end-to-end data solutions across AWS cloud and on-premises ( Oracle DB ) environments, working with Airflow , dbt , and SAP Data Services , and contributing to Data Mesh and ...
... Senior Data Engineer to join a growing Data & Analytics team and play a key role in developing and improving the company's data platform. Expected, Snowflake Data Cloud, SQL, Azure DevOps Optional, Azure DevOps, Microsoft Azure, Databricks Your responsibilities, Develop and maintain data pipelines and data warehouse solutions ...
Kraków, Polska
Zobacz ofertę
HIBERUS POLAND SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Wymagane, Python, Pandas, AWS, DynamoDB, Git Mile widziane, Veeam, Azure DevOps O projekcie, Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Tak pracujemy, rozwijasz kilka projektów jednocześnie, ...
... merit. • Competence in developing and maintaining API’s is considered a large merit. We are looking for an experienced Data Engineer professional to join our Data Product Team within the MDM unit. You will be responsible for provisioning data from our master data customer and product systems. Requirements: Python, Databricks, ...
Senior Data Engineer Miejsce pracy: Warszawa Technologies we use Expected - Google Cloud Platform - Terraform - Git - GitHub Actions - SQL - Python Optional - Docker - Kubernetes About the project We are looking for a Senior Data Engineer who will act as a technical mentor, define our architecture, and bring best practices ...
... Databricks, Delta Lake, Azure Data Factory, C#, Microsoft Azure Optional, Microsoft Power BI About the project, Senior Data Engineer role focused on end-to-end data engineering in modern cloud architectures, bridging business needs with technical solutions. Join agile product teams to manage MDM data products, optimize data flows, ...
... Microsoft SQL Server, SQL, PL/SQL, T-SQL, Kafka Optional, Snowflake, AWS S3 Operating system, Windows About the project, We are currently looking for a Senior Data Engineer to join our client, a dynamically growing company in the banking industry. In this role, you will be responsible for building and optimizing data pipelines, ...
... of strategic initiatives., , Opportunity Overview, As a Senior Data Engineer, you will play a key role in designing, building, and scaling our clients’ cloud data platforms. You’ll work closely with technical and business stakeholders, influence architecture decisions, and drive best engineering standards across teams., ...
Expected, Google Cloud Platform, Terraform, Git, GitHub Actions, SQL, Python Optional, Docker, Kubernetes About the project, We are looking for a Senior Data Engineer who will act as a technical mentor, define our architecture, and bring best practices to our Google Cloud ecosystem. You will step away from the daily grind ...
... we use Expected - SQL - Python About the project As a Senior Database Engineer, you will be responsible for designing, optimizing and scaling high-performance database infrastructure supporting millions of transactions and real-time data flows. You will work with transactional databases, document databases, Kafka-based streaming ...