Senior Big Data Engineer - Spark, Scala, Python, AWS w Łódź, Polska

• Zdalnie

21000 - 28560 zł

... commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. ...

• Kontrakt

$2k USD

We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...

• Zdalnie

... large-scale data processing systems. You will be responsible for designing systems that handle billions of requests daily, improving application efficiency and scalability. With a minimum of 8 years’ experience in software development, proficiency in Java, Scala, or Python, and expertise in Big Data systems, the role is pivotal ...

... will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using Hadoop and Apache Spark. Build scalable solutions for processing large volumes of data. Analyse complex business requirements and ...

Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset. Enjoy a flexible work environment, ...

DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets. The role involves collaboration with data scientists, DevOps, and IT to deliver ...

• Kontrakt

18000 - 25000 zł

Addepto is a leading AI consulting ( ) and data engineering ( ) company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With an exclusive focus on Artificial Intelligence and Big Data, Addepto helps ...

• Kontrakt

$2k USD

... technical field 5+ years experience in software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, ...

• Kontrakt

170 zł PLN

... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...

• Zdalnie
• Kontrakt

8k

Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...

• Zdalnie
• Kontrakt

... Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve large-scale Big Data and cloud-native platforms for global clients, including ...

• Zdalnie

1k zł PLN / year

... together At least 5-6 years of experience working as a Data Engineer, with a focus on Google Cloud Platform Data and Analytics., Strong hands-on experience with Python, dbt, and Airflow, Solid working knowledge of BigQuery and the wider GCP data stack, Experience in data modelling, integration and security, with Terraform, ...

• Kontrakt

20000 - 28000 zł

... OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work ...

1k - 4700

... description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with AWS: Glue, ...

25200 - 30240 zł

... ensuring transparency, collaboration, and continuous improvement. Required skills: • 5 years of experience in Data Engineering. • Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse. • Advanced programming skills in Python, PySpark, and ...

... Computer Science, Engineering, or related field At least 5 years of experience in Data Engineering with a strong ETL background Hands-on experience with Azure Data Factory, Azure Databricks, Azure SQL, ADLS Proficiency in Python, Scala, or Java and strong SQL skills Experience with big data frameworks, CI/CD, and Agile methodologies, ...

• Kontrakt

$2k USD

... and platforms Perform troubleshooting, debugging, and upgrading of data systems and applications Requirements 4+ years experience in software development with Data Software Engineering technologies Advanced knowledge of Python Proficient with Spark and Databricks Experience with cloud platforms such as Azure, Amazon Web ...

• Hybrydowo
• Stacjonarnie

29400 - 33600 zł

For our Danish client, we're looking for a Senior Data Engineer to lead the migration of existing Airflow workflows to Azure Data Factory (ADF) and support the data layer behind our reporting solutions. The role is primarily focused on data engineering, ideally with a good understanding of Power BI and reporting environments. ...

• Kontrakt

$2k USD

We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...