Wróć do listy

Opis oferty

BigData Architect (Databricks + AWS) w Polska

SoftServe

  • ZdalniePraca z dowolnego miejsca

Polska

  • Proven experience designing scalable data platforms and data pipeline architectures
  • Hands-on experience with batch and streaming data processing solutions
  • Strong expertise in AWS cloud services and Databricks platform components, including Delta Lake, Unity Catalog, Workflows, and Jobs
  • Proficiency in Python, Scala, or Java (preferably Python), along with strong SQL skills
  • Knowledge of big data technologies such as Apache Spark or Flink
  • Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
  • Practical experience with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
  • Familiarity with data warehousing solutions such as Snowflake or Amazon Redshift
  • Experience participating in customer-facing and pre-sales activities, including workshops, architecture discussion
In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment ,[Design and support implementation of scalable data solutions using Databricks on AWS, Develop and maintain batch and streaming data pipelines and Lakehouse architectures, Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans, Support data ingestion activities, including source-to-target mappings and integration of new data sources, Participate in architecture discussions and contribute to scaling the data platform and maintaining data models, Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows, Support implementation of real-time data processing solutions using Apache Kafka, Amazon MSK, or Kinesis, Utilize data warehousing solutions such as Snowflake or Amazon Redshift for analytics and storage, Create and maintain technical documentation, data schemas, and solution-related materials, Participate in the full project lifecycle, from PoC and MVP stages to production implementation, Explore new technologies, build prototypes, and contribute to knowledge sharing within the engineering communit] Requirements: AWS, Databricks Tools: .

Podobne oferty

Więcej podobnych stanowisk

moondigo sp. z o.o.

Databricks Architect

  • Zdalnie
  • Hybrydowo
  • Stacjonarnie
  • Kontrakt

175 - 210 zł / stawka godzinowa

Wymagane, Databricks, AWS, Unity Catalog, Terraform System operacyjny, Windows O projekcie, Do zespołu naszego klienta, międzynarodowej firmy biotechnologicznej z sektora Life Sciences, specjalizującej się w rozwoju innowacyjnych terapii i technologii opartych na mRNA, poszukujemy doświadczonego Databricks Architekta., ...

Warszawa, Polska

  • DevOps
... platform, cloud, SRE, architecture, and engineering teams,, support knowledge transfer, platform handover, and operational transition activities.] Requirements: AWS, Terraform, CI/CD, Databricks Asset Bundles, Databricks, Cloud, SRE, IQ/OQ, GXP Additionally: Training budget, Private healthcare, Multisport, Integration events, ...

Gdańsk, Polska

  • Zdalnie
  • IT

130 - 160 zł / stawka godzinowa

... Pipeline Engineering: Architect and enhance our core SDTM transformation engine, leveraging AWS Step Functions for orchestration, Lambda for compute, and Databricks for high-throughput data processing., API & Interface Development: Construct and refine responsive React/TypeScript interfaces backed by GraphQL (AWS AppSync) ...

Polska

  • Zdalnie
  • IT

130 - 160 zł / stawka godzinowa

... Pipeline Engineering: Architect and enhance our core SDTM transformation engine, leveraging AWS Step Functions for orchestration, Lambda for compute, and Databricks for high-throughput data processing., API & Interface Development: Construct and refine responsive React/TypeScript interfaces backed by GraphQL (AWS AppSync) ...

Polska

  • Zdalnie
  • Hybrydowo
  • Stacjonarnie
  • Pełny etat
  • Kontrakt
  • Cloud
... Code. - Take part in sovereign cloud and open-source-driven initiatives while accessing certification support and opportunities to develop towards Principal Architect or Technical Leadership roles. HERE’S WHAT YOU’LL NEED: - 7+ years in cloud, 3+ as architect/lead, delivering enterprise AWS solutions (networking, IAM, hybrid). ...

Warszawa, Polska

  • Zdalnie
  • Kontrakt
Senior Azure Databricks & Microsoft Fabric Architect Location: 100% Remote Start: ASAP / up to 1 month / flexible Contract: B2B via Experis We are looking for an experienced Azure Databricks & Microsoft Fabric Architect to design and deliver modern cloud data platforms for international projects. Key Responsibilities - ...

Warszawa, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect with Cloud (f/m/x) Miejsce pracy: Toruń Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - Microsoft Fabric - Python - ETL Mile widziane - Snowflake - AWS - Google Cloud Platform - Microsoft Power BI - Microsoft Azure ...

Toruń, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Szczecin Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault Mile widziane - Snowflake - Microsoft Power BI - Microsoft Azure - AWS O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution ...

Szczecin, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Katowice Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault Mile widziane - Snowflake - Microsoft Power BI - Microsoft Azure - AWS O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution ...

Katowice, Polska

  • Zdalnie
  • Pełny etat
  • Kontrakt
... production-grade AI-assisted KYC / Customer Due Diligence platform for an international insurance environment. We are looking for an experienced IT Solution Architect to own the technical design of the production solution across Azure and Databricks , including runtime architecture, networking, identities, environments, ...

Polska