Data Engineer (Databricks) w Warszawa, Poland - Jobeax
Opis oferty
Data Engineer (Databricks) w Warszawa, Polska
ZdalniePraca z dowolnego miejsca
Warszawa, Polska
Flexible approach - you can choose to work from home or meet at our offices. Benefits, sharing the costs of sports activities, private medical care, sharing the costs of foreign language classes, sharing the costs of professional training & courses, flexible working time, integration events, no dress code, leisure zone, employee referral program, charity initiatives
Praca z domu
Elastyczne godziny
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
... inclusive world. Your Tasks - Design and implement data processing solutions using Databricks for large-scale and diverse datasets. - Design, build, and enhance data pipelines with Python and cloud-native tools. - Work closely with solution architects to define and uphold best practices in data engineering. - Ensure data consistency, ...
... procesów danych, - współpraca z międzynarodowymi zespołami projektowymi i klientami. Nasze wymagania - minimum kilka lat doświadczenia komercyjnego w obszarze Data Engineering, - praktyczne doświadczenie z Databricks lub Snowflake, - bardzo dobra znajomość PySpark / Apache Spark, - dobra znajomość Python i SQL, - doświadczenie ...
... with Databricks and/or Snowflake - Practical experience with data acquisition using APIs, FTP downloads, and other data sources - Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas - Experience with data storage solutions including raw files and database systems ...
Your responsibilities - Formulate and execute innovative analytical solutions using Cloud Native, Big Data, and NoSQL-centric technologies - Develop and implement Cloud, On-Premise, and Hybrid solutions utilizing superior data frameworks - Collaborate with product and engineering teams to understand and drive decision-making ...
... analysis, and contribute to performance optimization - Ensure compliance with data governance, security, and regulatory standards Our requirements - 3-5 YoE in Data Engineering with Databricks - Very strong Python, SQL, PySpark programming skills - Data Platforms: Databricks (Delta Lake, DLT), cloud data lakes / lakehouse ...
... evaluate new technologies in the data engineering space Minimum 3 years of experience in a Data Engineer role or similar position, Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake), Extensive experience with Databricks and Apache Spark, Proficiency in SQL and experience ...
... site Your responsibilities, Design and implement data processing solutions using Databricks for large-scale and diverse datasets., Design, build, and enhance data pipelines with Python and cloud-native tools., Work closely with solution architects to define and uphold best practices in data engineering., Ensure data consistency, ...
... with Azure DevOps. - Experience with SQL Server. - English proficiency at a level suitable for direct client conversations. Optional - Experience with Azure Databricks or Microsoft Fabric. - Experience with data quality frameworks, including Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, ...
... data ingestion and transformation processes., Work with cloud-based data platforms and Databricks., Integrate data from multiple operational systems., Build data products that support aviation operations and decision-making., Work with APIs and data exchange services., Collaborate with data providers, engineers and business ...