The primary objective of the Data Engineer role is to enhance the organization's analytical capabilities by developing and managing SQL-based data solutions on the Databricks platform. This position aims to ensure robust data modeling and transformation processes that meet business needs. Main Responsibilities: Develop and maintain SQL-based data pipelines and transformation logic on Databricks. Design, implement, and optimize star and snowflake schemas for analytical workloads. Write and tune advanced SQL queries for reporting, aggregation, and data validation. Collaborate with data engineers and analysts to ensure data models meet business needs. Work with structured and semi-structured data from multiple sources. Contribute to improving data quality, performance, and maintainability. Key Requirements: Solid experience with SQL (including analytical functions, joins, subqueries, CTEs, window functions, etc.). Practical experience with Databricks, Spark, SQL, or similar distributed SQL engines. Strong understanding of data modeling principles, particularly star and snowflake schemas. Experience with relational databases (e.g., PostgreSQL, SQL Server, or similar). Familiarity with ETL/ELT concepts and best practices. Ability to work independently and collaboratively within a data team. Nice to Have: Exposure to dbt, Delta Lake, or data warehousing concepts. Experience with cloud platforms (Azure, GCP, or AWS). Other Details: Location: Poland, Remote Team Structure: Collaborates with data engineers and analysts
... Senior Data Engineer to join a growing Data & Analytics team and play a key role in developing and improving the company's data platform. Expected, Snowflake Data Cloud, SQL, Azure DevOps Optional, Azure DevOps, Microsoft Azure, Databricks Your responsibilities, Develop and maintain data pipelines and data warehouse solutions ...
... for an experienced Senior Data Engineer to join a cross-functional Agile team within the banking domain. The role focuses on designing and improving end-to-end data solutions across AWS cloud and on-premises ( Oracle DB ) environments, working with Airflow , dbt , and SAP Data Services , and contributing to Data Mesh and ...
Warszawa, Polska
Zobacz ofertę
HIBERUS POLAND SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Wymagane, Python, Pandas, AWS, DynamoDB, Git Mile widziane, Veeam, Azure DevOps O projekcie, Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Tak pracujemy, rozwijasz kilka projektów jednocześnie, ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...
... inclusive world. Your Tasks - Design and implement data processing solutions using Databricks for large-scale and diverse datasets. - Design, build, and enhance data pipelines with Python and cloud-native tools. - Work closely with solution architects to define and uphold best practices in data engineering. - Ensure data consistency, ...
... technology and build a more sustainable, more inclusive world. Insights and Data: Insights & Data is a dynamic team of over 400 professionals delivering cutting-edge data solutions. We specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across GCP, Azure and AWS. Our expertise spans the full ...
... Python, SQL, Microsoft Azure, Azure Data Factory, ETL/ELT, CI/CD, Databricks, Streaming Optional, dbt Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the opportunity to support and further develop an Azure-based data integration solution built primarily around Azure Data Factory ...
As a Senior Data Engineer – Azure, you will: - Design, develop, and maintain scalable and reliable data pipelines and enterprise data products. - Build and support data engineering solutions across cloud and on-premises environments. - Develop solutions using Azure Data Factory, Azure Synapse Analytics, Azure Data Lake ...
... are seeking an experienced Senior Data Engineer (GCP) to join our team. In this role, you will be responsible for defining the architecture and standards for data contracts within the company. You will design and implement data contracts, including formats, schemas, validation, and versioning processes. Main responsibilities: ...