Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
... experience - Experience working with complex requirements - Knowledge of Hive - Familiarity with basic concepts of machine learning, CI/CD pipelines, and big data - Strong analytical thinking and problem-solving skills - Very good command of English, both spoken and written Nice to have: - Knowledge of Spark Offer: - Private ...
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
... infrastruktury chmurowej CZEGO OD CIEBIE OCZEKUJEMY? Must have: Minimum 3 lata komercyjnego doświadczenia w obszarze Data Engineering Bardzo dobra znajomość Google Cloud Platform Praktyczne doświadczenie z BigQuery, Apache Airflow / Cloud Composer oraz dbt Bardzo dobra znajomość SQL Praktyczna znajomość Python Doświadczenie w ...
... and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. ...
... Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based data solutions, build robust pipelines, ...
... take ownership of strategic initiatives. Opportunity Overview As a Mid Python Engineer, you will design and build robust backend services and APIs that power data-driven products used by real users at scale. You'll work on meaningful, complex problems in a cloud-native environment - from architecting reliable API layers ...
DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets. The role involves collaboration with data scientists, DevOps, and IT to deliver ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
... not yours. You are equally happy developing something new or building on the work of others. Mandatory Skills Description: - - Strong hands-on experience with Python, PySpark, and Apache Spark. - - Experience with Microsoft Azure, cloud-native platforms, and Big Data technologies. - - Experience with Scala or experience in ...
... życia. Rozwijamy się i obecnie poszukujemy programisty Python z doświadczeniem w budowie rozwiązań opartych na LLM i systemach agentowych, na stanowisko AI Engineer with Python. Co będziesz robić? Projektować, implementować i utrzymywać aplikacje AI w Pythonie. Pracować z frameworkami służącymi do budowy agentów AI, takimi ...
... production systems Strong Python skills and the ability to design clean, maintainable backend code Good distributed systems judgment: concurrency, failure handling, data consistency, async work, and service boundaries Hands-on experience with cloud infrastructure such as AWS, GCP, or Azure Comfort with database schema design and ...
... experience in Data Engineering or Software Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, ...
... amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing and Business Intelligence. Good knowledge of common Python libraries and frameworks (Pandas, FastAPI, kubeflow pipelines, GCP libraries). Good knowledge ...
... master’s degree in Computer Science, Engineering, IT, or a related field. - 3+ years of professional experience as a Data Engineer. - Programming skills in Python, Java or Scala. - Experience with Spark and big-data frameworks. - Strong SQL and data modeling skills. - Experience with cloud platforms (AWS, Azure, GCP). ...
... work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive on handling genuinely complex data pipelines, event streaming, and ...
... global analytics use cases. Your tasks Design, build, and optimize scalable data pipelines (batch & real-time) Develop and maintain ETL processes and integrate data from multiple sources (including migrations) Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL) Ensure data ...
... technicznej. • Współpraca z zespołami technicznymi i biznesowymi. • Udział w implementacji, testach oraz optymalizacji rozwiązań. Wymagania • Doświadczenie w Data Modelling oraz Solution Design. • Bardzo dobra znajomość Python. • Bardzo dobra znajomość SQL oraz relacyjnych baz danych (Oracle, PostgreSQL, MS SQL lub podobnych). ...