Opis oferty

Senior/Lead Data Software Engineer (Python, Spark, Azure) w Wrocław, Polska

EPAM Systems (Poland) sp. z o.o.

  • KontraktUmowa czasowa lub freelancing

Wrocław, Polska

Your responsibilities

  • Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
  • Manage and process 12 TB of data efficiently across platforms
  • Tune machine learning models for Azure environments using Java Spark and Delta tables
  • Update and maintain libraries to address security vulnerabilities
  • Develop and maintain ETL/ELT pipelines using PySpark and related technologies
  • Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
  • Monitor data quality and implement improvements to ensure accuracy and reliability
  • Automate deployment and operational tasks using Terraform and GitLab CI/CD
  • Support data governance initiatives to comply with regulatory standards
  • Troubleshoot and resolve performance issues in data processing systems
  • Document system processes and provide technical guidance to junior engineers
  • Implement best practices for code quality and data security
  • Participate in code reviews and knowledge sharing sessions
  • Optimize costs associated with data storage and processing

Our requirements

  • Proficiency in Python and Spark with at least 3 years in data engineering roles
  • Strong experience with Azure Databricks and PySpark
  • Proven expertise in designing and implementing ETL/ELT solutions
  • Experience migrating big data platforms to Azure-native services
  • Proficiency with Delta tables for model tuning
  • Knowledge of data governance and regulatory compliance frameworks
  • Familiarity with Docker, Kubernetes (AKS), and Terraform for infrastructure automation
  • Ability to manage large data volumes with high efficiency
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities
  • English proficiency at B2 level or higher

What we offer

  • We gather like-minded people:
  • • Top tech minds driving innovation in AI, cloud and digital platform modernization
  • • Supportive team and agile, startup-like culture
  • • Hybrid by design mode and opportunity to work remotely within Poland
  • • Chance to work abroad for up to 60 days annually
  • • Business-driven relocation opportunities
  • We provide growth opportunities:
  • • Career development programs
  • • Thought leadership, mentoring, soft skills and well-being programs
  • • Certification (Anthropic, Gemini, GCP, Azure, AWS)
  • • English classes
  • We cover it all:
  • • Stable pay
  • • Participation in the Employee Stock Purchase Plan with a 15% discount
  • • Benefits package (health insurance, multisport, shopping vouchers)
  • • Referral bonuses up to $2,000
  • • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
  • • Corporate, social and well-being events
  • Please, note:
  • • Benefits listed above are available to employees only
  • • We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
  • • We will reach out to selected candidates exclusively
Aplikuj na ofertę

Podobne oferty

Więcej podobnych stanowisk

EPAM Systems (Poland) sp. z o.o.

Senior/Lead Data Software Engineer (Python, Spark, Azure)

  • Zdalnie
  • Hybrydowo
  • Kontrakt
  • IT

$2k USD

Expected, Pytest, Spark, Microsoft Azure, PySpark, Docker, Kubernetes, Terraform Cloud, Gtilab About the project, We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities., ...

Wrocław, Polska

EPAM Systems (Poland) sp. z o.o.

Senior/Lead Data Software Engineer (Python, Spark, Azure)

  • Zdalnie
  • Hybrydowo
  • Kontrakt
  • IT

$2k USD

Senior/Lead Data Software Engineer (Python, Spark, Azure) Miejsce pracy: Wrocław Technologies we use Expected - Pytest - Spark - Microsoft Azure - PySpark - Docker - Kubernetes - Terraform Cloud - Gtilab About the project We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready ...

Wrocław, Polska

Addepto

Senior Data Engineer / Tech Lead (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

... project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing solutions., , The role combines approximately 70% hands-on data engineering with 30% technical leadership. Alongside designing and developing data ...

Warszawa, Polska

Addepto

Senior Data Engineer / Tech Lead (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

... project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing solutions., , The role combines approximately 70% hands-on data engineering with 30% technical leadership. Alongside designing and developing data ...

Warszawa, Polska

Addepto

Senior Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

Katowice, Polska

Addepto

Senior Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

Białystok, Polska

EPAM Systems (Poland) sp. z o.o.

Senior Data Software Engineer (Python, GCP)

  • Zdalnie
  • Kontrakt
  • IT
Expected, Python, Scala, Java, Spark, Databricks, Snowflake, Microsoft Azure, Google Cloud Platform, SQL, Cassandra, MongoDB Optional, Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN, Solr, OpenSearch, Lucene Operating system, Windows About the project, We are looking for a Senior Data Software Engineer to join our growing ...

Warszawa, Polska

UPVANTA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • IT
  • Zarzadzanie projektami
  • Zarzadzanie produktem
  • Data Science
  • +1

1200 zł PLN

... dzielenie się wiedzą oraz wspieranie rozwoju technicznego zespołu. Minimum 5 lata praktycznego doświadczenia jak Data Engineer lub Big Data, Bardzo dobra znajomość PySpark, Spark SQL, DataFrames oraz Structured Streaming., Doświadczenie w odczycie i zapisie danych w MongoDB z wykorzystaniem MongoDB Spark Connector., Praktyczne ...

Wrocław, Polska

UPVANTA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • IT
  • Zarzadzanie projektami
  • Zarzadzanie produktem
  • Data Science
  • +1

1200 zł PLN

Data Engineer (Spark) Miejsce pracy: Wrocław Technologie, których używamy Wymagane - PyTorch Mile widziane - Kubernetes - Docker - Prometheus - Grafana - Jenkins - MongoDB - Apache Spark - PyTorch O projekcie Do zespołu Data Platform poszukujemy doświadczonego Data Engineer ( Spark), który będzie odpowiedzialny za projektowanie, ...

Wrocław, Polska

Link Group

Senior Software Engineer (Python)

  • Zdalnie
  • IT

130 - 160 zł / stawka godzinowa

... experienced Software Engineer (Senior / Lead) to help architect and scale our Clinical Data Layer —a cloud-native platform designed to harmonize complex clinical trial dataset streams into the standardized CDISC SDTM structure. In this end-to-end engineering position, you will build robust serverless data pipelines alongside the ...

Polska

Link Group

Senior Software Engineer (Python)

  • Zdalnie
  • IT

130 - 160 zł / stawka godzinowa

... experienced Software Engineer (Senior / Lead) to help architect and scale our Clinical Data Layer —a cloud-native platform designed to harmonize complex clinical trial dataset streams into the standardized CDISC SDTM structure. In this end-to-end engineering position, you will build robust serverless data pipelines alongside the ...

Polska