Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
... and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. ...
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
... Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities ...
... infrastruktury chmurowej CZEGO OD CIEBIE OCZEKUJEMY? Must have: Minimum 3 lata komercyjnego doświadczenia w obszarze Data Engineering Bardzo dobra znajomość Google Cloud Platform Praktyczne doświadczenie z BigQuery, Apache Airflow / Cloud Composer oraz dbt Bardzo dobra znajomość SQL Praktyczna znajomość Python Doświadczenie w ...
... Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based data solutions, build robust pipelines, ...
... specificationsPromote and uphold a high-performance engineering cultureWrite comprehensive project documentation Requirements Proficiency in Python and SQLExperience with Cloud platforms (Azure, AWS, or GCP)Practical experience with GenAI/LLM tools (such as ChatGPT, Claude, etc.) within the software/data delivery lifecycle (AI SDLC)Excellent ...
... specificationsPromote and uphold a high-performance engineering cultureWrite comprehensive project documentation Requirements Proficiency in Python and SQLExperience with Cloud platforms (Azure, AWS, or GCP)Practical experience with GenAI/LLM tools (such as ChatGPT, Claude, etc.) within the software/data delivery lifecycle (AI SDLC)Excellent ...
... take ownership of strategic initiatives. Opportunity Overview As a Mid Python Engineer, you will design and build robust backend services and APIs that power data-driven products used by real users at scale. You'll work on meaningful, complex problems in a cloud-native environment - from architecting reliable API layers ...
... production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in data integration, Python/SQL proficiency, and experience with Spark or Flink, as well as cloud data tools (GCP/AWS).
DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets. The role involves collaboration with data scientists, DevOps, and IT to deliver ...
... cloud-based architectures utilizing platforms like AWS, Azure, or Google Cloud Platform (GCP) - Create scalable microservices and serverless applications using cloud-native tools and frameworks - Optimize data pipelines and workflows using Python and cloud services such as AWS Lambda, Azure Functions, or GCP Cloud Functions ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
... not yours. You are equally happy developing something new or building on the work of others. Mandatory Skills Description: - - Strong hands-on experience with Python, PySpark, and Apache Spark. - - Experience with Microsoft Azure, cloud-native platforms, and Big Data technologies. - - Experience with Scala or experience in ...
... experience in implementing Continuous Integration and Continuous Deployment processes for data pipelines and applications. Proficiency in Python and PySpark for data processing, transformation, and analysis. Demonstrated experience in using Databricks for data engineering tasks, including working with Delta Lake and Spark ...
... programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta ...
... work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive on handling genuinely complex data pipelines, event streaming, and ...