Proven experience designing scalable data platforms and data pipeline architectures
Hands-on experience with batch and streaming data processing solutions
Strong expertise in AWS cloud services and Databricks platform components, including Delta Lake, Unity Catalog, Workflows, and Jobs
Proficiency in Python, Scala, or Java (preferably Python), along with strong SQL skills
Knowledge of big data technologies such as Apache Spark or Flink
Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
Practical experience with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
Familiarity with data warehousing solutions such as Snowflake or Amazon Redshift
Experience participating in customer-facing and pre-sales activities, including workshops, architecture discussion
In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment ,[Design and support implementation of scalable data solutions using Databricks on AWS, Develop and maintain batch and streaming data pipelines and Lakehouse architectures, Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans, Support data ingestion activities, including source-to-target mappings and integration of new data sources, Participate in architecture discussions and contribute to scaling the data platform and maintaining data models, Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows, Support implementation of real-time data processing solutions using Apache Kafka, Amazon MSK, or Kinesis, Utilize data warehousing solutions such as Snowflake or Amazon Redshift for analytics and storage, Create and maintain technical documentation, data schemas, and solution-related materials, Participate in the full project lifecycle, from PoC and MVP stages to production implementation, Explore new technologies, build prototypes, and contribute to knowledge sharing within the engineering communit] Requirements: AWS, Databricks Tools: .
Wymagane, Databricks, AWS, Unity Catalog, Terraform System operacyjny, Windows O projekcie, Do zespołu naszego klienta, międzynarodowej firmy biotechnologicznej z sektora Life Sciences, specjalizującej się w rozwoju innowacyjnych terapii i technologii opartych na mRNA, poszukujemy doświadczonego Databricks Architekta., ...
Wymagania - Bardzo dobra, praktyczna znajomość Databricks , obejmująca projektowanie architektury oraz administrację platformą. - Doświadczenie w projektowaniu i wdrażaniu platform danych w AWS . - Zaawansowana znajomość Unity Catalog , zarządzania dostępem i bezpieczeństwem danych. - Znajomość IAM , architektury sieciowej, ...
... platforms using Databricks, Lakehouse Architecture, Delta Lake, and cloud technologies., Translate business requirements into scalable, secure, and maintainable architecture solutions., Define target architectures, integration patterns, governance frameworks, and delivery standards., Lead architecture workshops, technical discussions, ...
... Pipeline Engineering: Architect and enhance our core SDTM transformation engine, leveraging AWS Step Functions for orchestration, Lambda for compute, and Databricks for high-throughput data processing., API & Interface Development: Construct and refine responsive React/TypeScript interfaces backed by GraphQL (AWS AppSync) ...
... - Podstawowa wiedza na temat Data Lake i przechowywania danych. - Zainteresowanie obszarem Big Data oraz chęć nauki technologii takich jak Spark/PySpark i Databricks . - Podstawowa znajomość co najmniej jednej chmury publicznej (AWS, GCP lub Azure) lub chęć rozwijania się w tym kierunku. - Podstawowa wiedza na temat CI/CD ...
Data Solution Architect (f/m/x) Miejsce pracy: Bydgoszcz Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - AWS Mile widziane - Snowflake O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution Architekta, który wesprze ...
Data Solution Architect (f/m/x) Miejsce pracy: Katowice Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - AWS Mile widziane - Snowflake O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution Architekta, który wesprze ...
... wizualizacji danych (np. Power BI) oraz technologii wspierających przetwarzanie danych w czasie rzeczywistym, analityki AI, Certyfikaty związane z chmurą (np. AWS Certified Solutions Architect, Microsoft Azure Solutions Architect) To oferujemy, Tytuł Great Place to Work od 2015 roku - to dzięki opiniom pracowników otrzymujemy ...