Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
... inclusive world. Your Tasks - Design and implement data processing solutions using Databricks for large-scale and diverse datasets. - Design, build, and enhance data pipelines with Python and cloud-native tools. - Work closely with solution architects to define and uphold best practices in data engineering. - Ensure data consistency, ...
... procesów danych, - współpraca z międzynarodowymi zespołami projektowymi i klientami. Nasze wymagania - minimum kilka lat doświadczenia komercyjnego w obszarze Data Engineering, - praktyczne doświadczenie z Databricks lub Snowflake, - bardzo dobra znajomość PySpark / Apache Spark, - dobra znajomość Python i SQL, - doświadczenie ...
... with Databricks and/or Snowflake - Practical experience with data acquisition using APIs, FTP downloads, and other data sources - Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas - Experience with data storage solutions including raw files and database systems ...
Your responsibilities - Formulate and execute innovative analytical solutions using Cloud Native, Big Data, and NoSQL-centric technologies - Develop and implement Cloud, On-Premise, and Hybrid solutions utilizing superior data frameworks - Collaborate with product and engineering teams to understand and drive decision-making ...
... site Your responsibilities, Design and implement data processing solutions using Databricks for large-scale and diverse datasets., Design, build, and enhance data pipelines with Python and cloud-native tools., Work closely with solution architects to define and uphold best practices in data engineering., Ensure data consistency, ...
... with Azure DevOps. - Experience with SQL Server. - English proficiency at a level suitable for direct client conversations. Optional - Experience with Azure Databricks or Microsoft Fabric. - Experience with data quality frameworks, including Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, ...
About you - 3+ years of hands-on experience in Data Engineering or Software Engineering. - Degree in computer science, engineering or equivalent technical field experience. - Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. - Fluent in SQL and proficient in at least one ...
... maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark., Working with raw data and designing methods for its integration into the data platform., Developing CI/CD pipelines for data engineering solutions., Creating and maintaining Infrastructure as Code solutions., Integrating the data platform ...
... ROLE We are looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation. WHAT YOU WILL DO - Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL. - Build and operationalize ...