Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
... (Terraform, Bicep). - Experience with real-time data streaming technologies such as Kafka or Spark Streaming. - Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse. - Hands-on experience with PySpark for distributed data processing. - Relevant certifications such as Databricks Certified Data Engineer Associate ...
... with Databricks and/or Snowflake - Practical experience with data acquisition using APIs, FTP downloads, and other data sources - Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas - Experience with data storage solutions including raw files and database systems ...
Your responsibilities - Formulate and execute innovative analytical solutions using Cloud Native, Big Data, and NoSQL-centric technologies - Develop and implement Cloud, On-Premise, and Hybrid solutions utilizing superior data frameworks - Collaborate with product and engineering teams to understand and drive decision-making ...
Expected, Databricks, Python Optional, AWS, Microsoft Azure, Google Cloud Platform, PySpark, Kafka, SQL About the project, Insights & Data is a thriving team of over 400 professionals focused on delivering advanced data-driven solutions. Our expertise lies in Cloud & Big Data engineering, where we build scalable architectures ...
... compliance with data governance, security, and regulatory standards Our requirements - 3-5 YoE in Data Engineering with Databricks - Very strong Python, SQL, PySpark programming skills - Data Platforms: Databricks (Delta Lake, DLT), cloud data lakes / lakehouse architectures - Experience with Azure (ADLS, Data Factory, Synapse), ...
... evaluate new technologies in the data engineering space Minimum 3 years of experience in a Data Engineer role or similar position, Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake), Extensive experience with Databricks and Apache Spark, Proficiency in SQL and experience ...
... with Azure DevOps. - Experience with SQL Server. - English proficiency at a level suitable for direct client conversations. Optional - Experience with Azure Databricks or Microsoft Fabric. - Experience with data quality frameworks, including Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, ...
Wymagane, Databricks, SQL, Python, Apache Spark, PySpark, Data Lake, Lakehouse, Delta Lake Mile widziane, Microsoft Azure, Oracle, Azure Data Factory., Microsoft Fabric., Apache Kafka, GitHub Copilot System operacyjny, Windows O projekcie, Poszukujemy doświadczonego Databricks Engineera, który dołączy do projektu realizowanego ...