Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
... infrastruktury chmurowej CZEGO OD CIEBIE OCZEKUJEMY? Must have: Minimum 3 lata komercyjnego doświadczenia w obszarze Data Engineering Bardzo dobra znajomość Google Cloud Platform Praktyczne doświadczenie z BigQuery, Apache Airflow / Cloud Composer oraz dbt Bardzo dobra znajomość SQL Praktyczna znajomość Python Doświadczenie w ...
... and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. ...
... Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based data solutions, build robust pipelines, ...
... take ownership of strategic initiatives. Opportunity Overview As a Mid Python Engineer, you will design and build robust backend services and APIs that power data-driven products used by real users at scale. You'll work on meaningful, complex problems in a cloud-native environment - from architecting reliable API layers ...
... production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in data integration, Python/SQL proficiency, and experience with Spark or Flink, as well as cloud data tools (GCP/AWS).
DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets. The role involves collaboration with data scientists, DevOps, and IT to deliver ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
... not yours. You are equally happy developing something new or building on the work of others. Mandatory Skills Description: - - Strong hands-on experience with Python, PySpark, and Apache Spark. - - Experience with Microsoft Azure, cloud-native platforms, and Big Data technologies. - - Experience with Scala or experience in ...
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
... work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive on handling genuinely complex data pipelines, event streaming, and ...
... experience in Data Engineering or Software Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, ...
... amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing and Business Intelligence. Good knowledge of common Python libraries and frameworks (Pandas, FastAPI, kubeflow pipelines, GCP libraries). Good knowledge ...
... global analytics use cases. Your tasks Design, build, and optimize scalable data pipelines (batch & real-time) Develop and maintain ETL processes and integrate data from multiple sources (including migrations) Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL) Ensure data ...
We are looking for a Lead QA Automation Engineer with proven leadership experience in QA automation teams and strong experience with Big Data testing and distributed data validation. The role combines hands-on automation expertise in Python with team leadership, ensuring high-quality delivery across complex enterprise applications, ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
... cloud-based data transformation Solid background in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing ...