Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
... cloud-based data transformation Solid background in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing ...
... zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with ...
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
Expected, Python, SQL, Microsoft SQL Server, PostgreSQL Optional, Microsoft Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve ...
... colleagues ask to check their work, keep reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes ...
... years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work leveraging good practices of ...
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
... exemplary projects: Petabyte-scale data platform migration to Google Cloud Migration of 1,000+ active pipelines to GCP. Rearchitecture of Spark applications to Cloud Dataproc or BigQuery SQL. Automation with Cloud Composer. Data analytics platform for an investing company Azure-based data platform with Databricks as the central ...
... software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, databases, and tools Strong understanding of ...
As a Senior Software Engineer, you design and develop distributed back-end applications in the Google Cloud. With your products, you enable our customers to quickly and flexibly determine the appropriate target groups for coupons, newsletters and more. This means that you take responsibility for an integral part of the ...
... microservices, APIs, and backend systems. Strong understanding of databases: relational (PostgreSQL, MySQL) and/or NoSQL (MongoDB, Firestore). Experience with any cloud providers (AWS/Azure/GCP). Familiarity with CI/CD pipelines, Docker, Git, and modern DevOps practices. Strong understanding of software engineering principles: ...
Ericsson GmbH in Krakow, Poland, is seeking a Scrum Master who is also eager to grow as a Software DevOps Engineer. You will foster an agile environment, support CI workflows in a modern Engineering Environment, and work with Linux, Python, Bash, and Git in an international team. The role is based in Krakow with a hybrid ...
... Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience with relational databases Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments Strong programming skills in Python, Scala, or Java Experience with ...
... reporting. Ensure compliance with regulatory and data governance requirements. Collaborate with product managers and domain experts in an agile setting. Document data pipelines, models, and key design decisions. Key Requirements Proficiency in Python, PySpark and SQL Experience with ETL/ELT pipeline development Cloud data warehouse/lake ...
... Power BI (PBI) Report Testing - Knowledge of CI/CD pipelines and Azure DevOps - Domain experience: corporate banking or investment banking (products, reference data, market data, etc.) - PySpark We offer: - Hybrid working model - Dynamic and innovation-driven engineering environment - Full-time job agreement based on b2b ...
130 - 160 zł / stawka godzinowa
Forma współpracy: Kontrakt B2B z IT LeasingTeam. Długofalowy kontrakt z gwarancją rozwoju w zespole wybitnych ekspertów technicznych, Tryb pracy: W pełni zdalny
Zasugerowane
Stawka godzinowa
Praca zdalna
... Overgaard. How you will make an impact As an Experienced Data Platform Engineer, you will join an international team responsible for developing and maintaining Arla’s Data Foundation Platform. You will contribute to the continuous evolution of our cloud-based data platform, ensuring scalability, reliability and performance across ...
... Experience working with large datasets and designing scalable data pipelines. Knowledge of data quality, validation and monitoring practices. Familiarity with cloud-based data platforms and modern data engineering concepts. Experience with version control and CI/CD practices. Knowledge of Python or another programming language ...
#5764 We are looking for a Middle Data Analytics Engineer to build reusable, production-grade pipelines that power our data deals, which are large-scale curated training sets for leading AI labs. You’ll ship engineering solutions with immediate revenue impact and collaborate with some of the world’s largest AI companies. ...
... scalable data pipelines, datasets, and data models. The primary focus is on enabling accurate process analysis and supporting continuous improvement through robust data engineering and efficient integration of multiple source systems. Data Engineer - Process Mining Requirements: 3 to 5 years of experience in similar position. ...