Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
... cloud-based data transformation Solid background in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing ...
Expected, Python, SQL, Microsoft SQL Server, PostgreSQL Optional, Microsoft Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve ...
... colleagues ask to check their work, keep reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes ...
... years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work leveraging good practices of ...
... zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with ...
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
... CDC. We are looking for a mid/senior Data Platform Engineer (backend) to join our team in Warsaw. Desired skills include: experience designing and maintaining data pipelines using ETL and/or ELT approaches, with the ability to reason about trade-offs rather than defaulting to a single pattern understanding of data pipeline ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
... ensuring transparency, collaboration, and continuous improvement. Required skills: • 5 years of experience in Data Engineering. • Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse. • Advanced programming skills in Python, PySpark, and ...
... zespołu, podejmowanie decyzji i wyznaczanie priorytetów • Praktyczna znajomość narzędzi CRM / marketing automation oraz SQL i/lub SAS; mile widziana znajomość Python • Doświadczenie w analizie danych, interpretacji wyników i podejmowaniu decyzji na ich podstawie • Znajomość metod testowania (A/B, eksperymenty) i optymalizacji ...
... exemplary projects: Petabyte-scale data platform migration to Google Cloud Migration of 1,000+ active pipelines to GCP. Rearchitecture of Spark applications to Cloud Dataproc or BigQuery SQL. Automation with Cloud Composer. Data analytics platform for an investing company Azure-based data platform with Databricks as the central ...
... software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, databases, and tools Strong understanding of ...
Ericsson GmbH in Krakow, Poland, is seeking a Scrum Master who is also eager to grow as a Software DevOps Engineer. You will foster an agile environment, support CI workflows in a modern Engineering Environment, and work with Linux, Python, Bash, and Git in an international team. The role is based in Krakow with a hybrid ...
... Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience with relational databases Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments Strong programming skills in Python, Scala, or Java Experience with ...
#5764 We are looking for a Middle Data Analytics Engineer to build reusable, production-grade pipelines that power our data deals, which are large-scale curated training sets for leading AI labs. You’ll ship engineering solutions with immediate revenue impact and collaborate with some of the world’s largest AI companies. ...
... scalable data pipelines, datasets, and data models. The primary focus is on enabling accurate process analysis and supporting continuous improvement through robust data engineering and efficient integration of multiple source systems. Data Engineer - Process Mining Requirements: 3 to 5 years of experience in similar position. ...
... management. Troubleshooting issues across data pipelines. Key Requirements Proficiency in at least one programming language, preferably Python. Strong knowledge of AWS cloud services including S3, Glue, and Lambda. Solid understanding of databases and data processing pipelines. Hands-on experience with software engineering best practices. ...
WYMAGANIA: Minimum 4 lata doświadczenia na stanowisku Data Engineera lub w pokrewnej roli Bardzo dobra znajomość Python oraz SQL Doświadczenie w budowie i utrzymaniu pipeline’ów danych (ETL/ELT) Praktyczna znajomość pracy z danymi ustrukturyzowanymi i nieustrukturyzowanymi (transformacje, normalizacja, przygotowanie) Umiejętność ...