... procesów danych, - współpraca z międzynarodowymi zespołami projektowymi i klientami. Nasze wymagania - minimum kilka lat doświadczenia komercyjnego w obszarze Data Engineering, - praktyczne doświadczenie z Databricks lub Snowflake, - bardzo dobra znajomość PySpark / Apache Spark, - dobra znajomość Python i SQL, - doświadczenie ...
Expected, Python, Databricks, SQL, Microsoft Azure Optional, Airflow, Dagster, Apache Spark, Microsoft Power BI, Azure Event Hub, Kafka, Terraform Operating system, Windows, macOS About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging ...
... site Your responsibilities, Design and implement data processing solutions using Databricks for large-scale and diverse datasets., Design, build, and enhance data pipelines with Python and cloud-native tools., Work closely with solution architects to define and uphold best practices in data engineering., Ensure data consistency, ...
... (Terraform, Bicep). - Experience with real-time data streaming technologies such as Kafka or Spark Streaming. - Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse. - Hands-on experience with PySpark for distributed data processing. - Relevant certifications such as Databricks Certified Data Engineer Associate ...
Senior Data Engineer (Databricks & Python) Miejsce pracy: Warszawa Technologies we use Expected - Python - PySpark - Spark SQL - Delta Lake About the project We are looking for an experienced Senior Data Engineer to join our Labeling Data Platform team. The platform supports the collection, processing, transformation, governance, ...
... This project addressed critical data management challenges, boosting user adoption, performance, and data integrity. The team is implementing a comprehensive data catalog, leveraging Databricks and Apache Spark/PySpark, for simplified data access and governance. Secure integration solutions and enhanced data quality monitoring, ...
... and implement physical data models in Snowflake, focusing on scalability, performance, and maintainability. - Translate conceptual and logical models into Snowflake-ready schemas, tables, and views. - Collaborate with data engineers to refine ETL/ELT processes and data integration patterns. - Align models and metadata ...
... and guide technical standards - Represent the team in technical alignment with client and partner teams Our requirements - Proven commercial experience as a Data Engineer (Mid: approx. 3+ years; Senior: approx. 5+ years) - Hands-on experience with Snowflake, including data modeling, roles and access, and performance optimization ...
Your responsibilities - Formulate and execute innovative analytical solutions using Cloud Native, Big Data, and NoSQL-centric technologies - Develop and implement Cloud, On-Premise, and Hybrid solutions utilizing superior data frameworks - Collaborate with product and engineering teams to understand and drive decision-making ...
... on Data & AI projects - Build modern data platforms that enable analytics, machine learning, and AI. - Grow your Databricks expertise - Work with the latest Databricks technologies, cloud platforms, and engineering best practices. - Learn from experienced specialists - Collaborate with Architects, Engineers, and Data Scientists ...