Wróć do listy

Opis oferty

BigData Architect (Databricks + AWS) w Polska

SoftServe

  • ZdalniePraca z dowolnego miejsca

Polska

  • Proven experience designing scalable data platforms and data pipeline architectures
  • Hands-on experience with batch and streaming data processing solutions
  • Strong expertise in AWS cloud services and Databricks platform components, including Delta Lake, Unity Catalog, Workflows, and Jobs
  • Proficiency in Python, Scala, or Java (preferably Python), along with strong SQL skills
  • Knowledge of big data technologies such as Apache Spark or Flink
  • Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
  • Practical experience with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
  • Familiarity with data warehousing solutions such as Snowflake or Amazon Redshift
  • Experience participating in customer-facing and pre-sales activities, including workshops, architecture discussion
In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment ,[Design and support implementation of scalable data solutions using Databricks on AWS, Develop and maintain batch and streaming data pipelines and Lakehouse architectures, Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans, Support data ingestion activities, including source-to-target mappings and integration of new data sources, Participate in architecture discussions and contribute to scaling the data platform and maintaining data models, Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows, Support implementation of real-time data processing solutions using Apache Kafka, Amazon MSK, or Kinesis, Utilize data warehousing solutions such as Snowflake or Amazon Redshift for analytics and storage, Create and maintain technical documentation, data schemas, and solution-related materials, Participate in the full project lifecycle, from PoC and MVP stages to production implementation, Explore new technologies, build prototypes, and contribute to knowledge sharing within the engineering communit] Requirements: AWS, Databricks Tools: .

Podobne oferty

Więcej podobnych stanowisk

moondigo sp. z o.o.

Databricks Architect

  • Hybrydowo
  • Stacjonarnie
  • Kontrakt
Wymagania - Bardzo dobra, praktyczna znajomość Databricks , obejmująca projektowanie architektury oraz administrację platformą. - Doświadczenie w projektowaniu i wdrażaniu platform danych w AWS . - Zaawansowana znajomość Unity Catalog , zarządzania dostępem i bezpieczeństwem danych. - Znajomość IAM , architektury sieciowej, ...

Warszawa, Polska

... platforms using Databricks, Lakehouse Architecture, Delta Lake, and cloud technologies., Translate business requirements into scalable, secure, and maintainable architecture solutions., Define target architectures, integration patterns, governance frameworks, and delivery standards., Lead architecture workshops, technical discussions, ...

Polska

  • Zdalnie
  • IT

130 - 160 zł / stawka godzinowa

... Pipeline Engineering: Architect and enhance our core SDTM transformation engine, leveraging AWS Step Functions for orchestration, Lambda for compute, and Databricks for high-throughput data processing., API & Interface Development: Construct and refine responsive React/TypeScript interfaces backed by GraphQL (AWS AppSync) ...

Polska

Edge One Solutions Sp. z o.o.

AWS Security Lead / Architect

  • Zdalnie
AWS Security Lead / Architect Miejsce pracy: Warszawa Technologie, których używamy Wymagane - AWS Cloud Security - AWS Mile widziane - Python - JavaScript - TypeScript - Terraform - CloudFormation - AWS CDK - GitHub Actions - GitLab CI - AWS CodePipeline O projekcie Klient to międzynarodowa firma technologiczno-produkcyjna ...

Warszawa, Polska

Vertex Recruitments

Trainee Data Engineer

  • Zdalnie
  • Kontrakt
... - Podstawowa wiedza na temat Data Lake i przechowywania danych. - Zainteresowanie obszarem Big Data oraz chęć nauki technologii takich jak Spark/PySpark i Databricks . - Podstawowa znajomość co najmniej jednej chmury publicznej (AWS, GCP lub Azure) lub chęć rozwijania się w tym kierunku. - Podstawowa wiedza na temat CI/CD ...

Gdańsk, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Bydgoszcz Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - AWS Mile widziane - Snowflake O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution Architekta, który wesprze ...

Bydgoszcz, Polska

  • Zdalnie

1000k zł PLN / year

Data Solution Architect (f/m/x) Miejsce pracy: Katowice Technologie, których używamy Wymagane - DWH - Data Lake - Databricks - Kimball Dimensional Modeling - Data Vault - Microsoft Azure - AWS Mile widziane - Snowflake O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution Architekta, który wesprze ...

Katowice, Polska

  • Hybrydowo
  • Stacjonarnie
  • Kontrakt
  • Cloud

170 - 190 zł / stawka godzinowa

... wsparcie podczas realizacji projektu. ,[] Requirements: Cloud, C, AWS, Microsoft Azure, Google Cloud Platform, GCP, Infrastructure as Code, Terraform, Bicep, AWS CDK, CD, GitOps, RBAC, PIM, WAN, Azure SQL, Databricks, Fabric, IAM, Security, VPC, VPN, KMS, BigQuery, PUB, AI, Gateway, AWS S3, Glue, GPT, Claude, Gemini [{"name": ...

Gdańsk, Polska

  • Zdalnie

1000k zł PLN / year

... wizualizacji danych (np. Power BI) oraz technologii wspierających przetwarzanie danych w czasie rzeczywistym, analityki AI, Certyfikaty związane z chmurą (np. AWS Certified Solutions Architect, Microsoft Azure Solutions Architect) To oferujemy, Tytuł Great Place to Work od 2015 roku - to dzięki opiniom pracowników otrzymujemy ...

Gdańsk, Polska

OPTIVEUM sp. z o.o.

Cloud Architect

  • Hybrydowo
  • Stacjonarnie
  • Pełny etat
  • Kontrakt
  • Cloud

190 zł / stawka godzinowa

... - Architect hybrid deployments spanning multiple cloud providers and on-premise infrastructure - Support on-premise to cloud migration activities - Provide architectural support to the Core Technology Architecture and Engineering department Requirements: - At least senior-level experience as a Cloud Architect - Proven experience ...

Warszawa, Polska