Wróć do listy

Opis oferty

Senior/Lead Data Software Engineer (Python, Spark, Azure) w Wrocław, Polska

EPAM Systems (Poland) sp. z o.o.

  • KontraktUmowa czasowa lub freelancing

Wrocław, Polska

Your responsibilities

  • Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
  • Manage and process 12 TB of data efficiently across platforms
  • Tune machine learning models for Azure environments using Java Spark and Delta tables
  • Update and maintain libraries to address security vulnerabilities
  • Develop and maintain ETL/ELT pipelines using PySpark and related technologies
  • Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
  • Monitor data quality and implement improvements to ensure accuracy and reliability
  • Automate deployment and operational tasks using Terraform and GitLab CI/CD
  • Support data governance initiatives to comply with regulatory standards
  • Troubleshoot and resolve performance issues in data processing systems
  • Document system processes and provide technical guidance to junior engineers
  • Implement best practices for code quality and data security
  • Participate in code reviews and knowledge sharing sessions
  • Optimize costs associated with data storage and processing

Our requirements

  • Proficiency in Python and Spark with at least 3 years in data engineering roles
  • Strong experience with Azure Databricks and PySpark
  • Proven expertise in designing and implementing ETL/ELT solutions
  • Experience migrating big data platforms to Azure-native services
  • Proficiency with Delta tables for model tuning
  • Knowledge of data governance and regulatory compliance frameworks
  • Familiarity with Docker, Kubernetes (AKS), and Terraform for infrastructure automation
  • Ability to manage large data volumes with high efficiency
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities
  • English proficiency at B2 level or higher

What we offer

  • We gather like-minded people:
  • • Top tech minds driving innovation in AI, cloud and digital platform modernization
  • • Supportive team and agile, startup-like culture
  • • Hybrid by design mode and opportunity to work remotely within Poland
  • • Chance to work abroad for up to 60 days annually
  • • Business-driven relocation opportunities
  • We provide growth opportunities:
  • • Career development programs
  • • Thought leadership, mentoring, soft skills and well-being programs
  • • Certification (Anthropic, Gemini, GCP, Azure, AWS)
  • • English classes
  • We cover it all:
  • • Stable pay
  • • Participation in the Employee Stock Purchase Plan with a 15% discount
  • • Benefits package (health insurance, multisport, shopping vouchers)
  • • Referral bonuses up to $2,000
  • • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
  • • Corporate, social and well-being events
  • Please, note:
  • • Benefits listed above are available to employees only
  • • We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
  • • We will reach out to selected candidates exclusively
Aplikuj na ofertę

Podobne oferty

Więcej podobnych stanowisk

EPAM Systems

Senior/Lead Data Software Engineer (Python, Spark, Azure)

We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities. You will play a key role in migrating from an IaaS Big Data platform to Azure-native Databricks, optimizing ...

Wrocław, Polska

EPAM Systems (Poland) sp. z o.o.

Senior/Lead Data Software Engineer (Python, Spark, Azure)

  • Zdalnie
  • Hybrydowo
  • Kontrakt
  • IT

$2k USD

Expected, Pytest, Spark, Microsoft Azure, PySpark, Docker, Kubernetes, Terraform Cloud, Gtilab About the project, We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities., ...

Wrocław, Polska

Addepto

Senior Data Engineer / Tech Lead (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

... project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing solutions., , The role combines approximately 70% hands-on data engineering with 30% technical leadership. Alongside designing and developing data ...

Warszawa, Polska

Addepto

Senior Data Engineer / Tech Lead (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

... project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing solutions., , The role combines approximately 70% hands-on data engineering with 30% technical leadership. Alongside designing and developing data ...

Warszawa, Polska

Addepto

Senior Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

Kraków, Polska

Addepto

Senior Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

Katowice, Polska

Addepto

Senior Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • Zarzadzanie projektami
  • Data Science

21000 - 28560 zł

Expected, Python, SQL, Spark, Airflow, AWS, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging ...

Białystok, Polska

Link Group

Senior Software Engineer - Python/React/Data

32000 zł

... and legacy system modernization. We are looking for a Senior Software Engineer to develop and maintain reporting applications combining backend development, data engineering, database technologies, and frontend solutions. The role focuses on building reliable data workflows and intuitive reporting tools using Python, SQL, ...

Warszawa, Polska

EPAM Systems (Poland) sp. z o.o.

Senior Data Software Engineer (Python, GCP)

  • Zdalnie
  • Kontrakt
  • IT
Expected, Python, Scala, Java, Spark, Databricks, Snowflake, Microsoft Azure, Google Cloud Platform, SQL, Cassandra, MongoDB Optional, Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN, Solr, OpenSearch, Lucene Operating system, Windows About the project, We are looking for a Senior Data Software Engineer to join our growing ...

Warszawa, Polska

Software Mind

[GVI] Senior Software Engineer (Python + Cloud + Data)

... Expectations – the experience you need - Around 4–7 years of hands-on commercial software engineering experience - Strong production Python skills across services and data pipelines, including testing and CI/CD - In-depth cloud experience (compute, managed databases, serverless, IAM), ideally on GCP, though AWS or Azure experience ...

Kraków, Polska

UPVANTA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Data Engineer (Spark)

  • Zdalnie
  • Kontrakt
  • IT
  • Zarzadzanie projektami
  • Zarzadzanie produktem
  • Data Science
  • +1

1200 zł PLN

... dzielenie się wiedzą oraz wspieranie rozwoju technicznego zespołu. Minimum 5 lata praktycznego doświadczenia jak Data Engineer lub Big Data, Bardzo dobra znajomość PySpark, Spark SQL, DataFrames oraz Structured Streaming., Doświadczenie w odczycie i zapisie danych w MongoDB z wykorzystaniem MongoDB Spark Connector., Praktyczne ...

Wrocław, Polska