Wróć do listy

Opis oferty

BigData Architect (Databricks + AWS) w Polska

SoftServe

  • ZdalniePraca z dowolnego miejsca

Polska

  • Proven experience designing scalable data platforms and data pipeline architectures
  • Hands-on experience with batch and streaming data processing solutions
  • Strong expertise in AWS cloud services and Databricks platform components, including Delta Lake, Unity Catalog, Workflows, and Jobs
  • Proficiency in Python, Scala, or Java (preferably Python), along with strong SQL skills
  • Knowledge of big data technologies such as Apache Spark or Flink
  • Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
  • Practical experience with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
  • Familiarity with data warehousing solutions such as Snowflake or Amazon Redshift
  • Experience participating in customer-facing and pre-sales activities, including workshops, architecture discussion
In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment ,[Design and support implementation of scalable data solutions using Databricks on AWS, Develop and maintain batch and streaming data pipelines and Lakehouse architectures, Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans, Support data ingestion activities, including source-to-target mappings and integration of new data sources, Participate in architecture discussions and contribute to scaling the data platform and maintaining data models, Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows, Support implementation of real-time data processing solutions using Apache Kafka, Amazon MSK, or Kinesis, Utilize data warehousing solutions such as Snowflake or Amazon Redshift for analytics and storage, Create and maintain technical documentation, data schemas, and solution-related materials, Participate in the full project lifecycle, from PoC and MVP stages to production implementation, Explore new technologies, build prototypes, and contribute to knowledge sharing within the engineering communit] Requirements: AWS, Databricks Tools: .

Podobne oferty

Więcej podobnych stanowisk

  • DevOps
... platform, cloud, SRE, architecture, and engineering teams,, support knowledge transfer, platform handover, and operational transition activities.] Requirements: AWS, Terraform, CI/CD, Databricks Asset Bundles, Databricks, Cloud, SRE, IQ/OQ, GXP Additionally: Training budget, Private healthcare, Multisport, Integration events, ...

Gdańsk, Polska

  • Zdalnie

21000 - 25000 zł

... scalable batch and streaming data pipelines, Build and optimize data processing solutions using Python (PySpark) and SQL, Develop and manage data workflows using Databricks on AWS, Work with Apache Spark and Databricks for large-scale data processing, Implement and maintain Delta Lake-based data architectures, Utilize orchestration ...

Polska

  • Zdalnie
  • Hybrydowo
  • Stacjonarnie
  • Pełny etat
  • Kontrakt
  • Cloud
... Code. - Take part in sovereign cloud and open-source-driven initiatives while accessing certification support and opportunities to develop towards Principal Architect or Technical Leadership roles. HERE’S WHAT YOU’LL NEED: - 7+ years in cloud, 3+ as architect/lead, delivering enterprise AWS solutions (networking, IAM, hybrid). ...

Warszawa, Polska

  • Zdalnie
  • Kontrakt
Senior Azure Databricks & Microsoft Fabric Architect Location: 100% Remote Start: ASAP / up to 1 month / flexible Contract: B2B via Experis We are looking for an experienced Azure Databricks & Microsoft Fabric Architect to design and deliver modern cloud data platforms for international projects. Key Responsibilities - ...

Warszawa, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect with Cloud (f/m/x) Miejsce pracy: Toruń Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - Microsoft Fabric - Python - ETL Mile widziane - Snowflake - AWS - Google Cloud Platform - Microsoft Power BI - Microsoft Azure ...

Toruń, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Szczecin Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault Mile widziane - Snowflake - Microsoft Power BI - Microsoft Azure - AWS O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution ...

Szczecin, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Katowice Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault Mile widziane - Snowflake - Microsoft Power BI - Microsoft Azure - AWS O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution ...

Katowice, Polska

  • Zdalnie
  • Pełny etat
  • Kontrakt
... production-grade AI-assisted KYC / Customer Due Diligence platform for an international insurance environment. We are looking for an experienced IT Solution Architect to own the technical design of the production solution across Azure and Databricks , including runtime architecture, networking, identities, environments, ...

Polska

  • Zdalnie

1000k zł PLN / year

... wizualizacji danych (np. Power BI) oraz technologii wspierających przetwarzanie danych w czasie rzeczywistym, analityki AI, Certyfikaty związane z chmurą (np. AWS Certified Solutions Architect, Microsoft Azure Solutions Architect) To oferujemy, Tytuł Great Place to Work od 2015 roku - to dzięki opiniom pracowników otrzymujemy ...

Pyla, Polska

  • Zdalnie

1000k zł PLN / year

... wizualizacji danych (np. Power BI) oraz technologii wspierających przetwarzanie danych w czasie rzeczywistym, analityki AI, Certyfikaty związane z chmurą (np. AWS Certified Solutions Architect, Microsoft Azure Solutions Architect) To oferujemy, Tytuł Great Place to Work od 2015 roku - to dzięki opiniom pracowników otrzymujemy ...

Rzeszów, Polska