Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 120,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
Expected, Python, CPI, GitHub, AWS tools, Databricks Operating system, Windows About the project, Due to the development of John Deere Business Service Center, we are currently seeking candidates for the position of:, , Python Software Engineer - IT Payroll Integrations Your responsibilities, Design and implement solutions ...
... experience in implementing Continuous Integration and Continuous Deployment processes for data pipelines and applications. Proficiency in Python and PySpark for data processing, transformation, and analysis. Demonstrated experience in using Databricks for data engineering tasks, including working with Delta Lake and Spark ...
... programme team to support overall migration efforts. Participate in CI/CD processes for efficient deployment. Key Requirements: Senior hands-on experience with Azure Databricks (jobs, clusters, Unity Catalog, SQL warehouses). Expertise in PySpark / Python for transformation logic and ETL pipelines. Solid working knowledge of Delta ...
... work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive on handling genuinely complex data pipelines, event streaming, and ...
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
... experience in Data Engineering or Software Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, ...
Konsultant wdrożeniowiec o profilu Data Engineer to specjalista, który łączy zaawansowane kompetencje techniczne z umiejętnością analizy danych i podstawową wiedzą z zakresu Data Science. Odpowiada za projektowanie, wdrażanie oraz utrzymanie nowoczesnych rozwiązań w obszarze Big Data, architektury danych i platform analitycznych, ...
... amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing and Business Intelligence. Good knowledge of common Python libraries and frameworks (Pandas, FastAPI, kubeflow pipelines, GCP libraries). Good knowledge ...
... global analytics use cases. Your tasks Design, build, and optimize scalable data pipelines (batch & real-time) Develop and maintain ETL processes and integrate data from multiple sources (including migrations) Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL) Ensure data ...
We are looking for a Lead QA Automation Engineer with proven leadership experience in QA automation teams and strong experience with Big Data testing and distributed data validation. The role combines hands-on automation expertise in Python with team leadership, ensuring high-quality delivery across complex enterprise applications, ...
... enable efficient, data-driven quality engineering across multiple projects. Responsibilities Design and develop an enterprise test automation platform using Python, Selenium, SQL, and API testing frameworksBuild reusable automation libraries and integrate automated testing into CI/CD pipelinesDevelop AI-powered automation ...
We are looking for a Lead QA Automation Engineer with proven leadership experience in QA automation teams and strong experience with Big Data testing and distributed data validation. The role combines hands-on automation expertise in Python with team leadership, ensuring high-quality delivery across complex enterprise applications, ...
Capco Poland is seeking an experienced Business Analyst to support the Market Risk Platforms area. You will collaborate with Market Risk, Technology and Data stakeholders to automate risk reporting and data analysis with Python. The role is hands-on, involving risk data work, data quality checks, and delivering well-defined ...
... new domain — insurance underwriting, healthcare revenue cycle, asset flow. Build * Design and ship production GenAI systems into the customer’s environment (cloud-native data, LLM-based, and agentic AI solutions). Implement and optimize RAG systems for production use cases * Build the evaluation harness before you build ...
Expected, Python, SQL, Microsoft SQL Server, PostgreSQL Optional, Microsoft Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve ...
... exemplary projects: Petabyte-scale data platform migration to Google Cloud Migration of 1,000+ active pipelines to GCP. Rearchitecture of Spark applications to Cloud Dataproc or BigQuery SQL. Automation with Cloud Composer. Data analytics platform for an investing company Azure-based data platform with Databricks as the central ...
Luxoft is seeking a data-focused developer in Wrocław, Poland, to join their technology team. The role involves developing scalable web applications and building user interfaces using data from various APIs. Applicants should possess strong SQL, Python skills, and experience with cloud data platforms like AWS. Responsibilities ...
... migrating the Pricing team to a new target data platform. Work with technical teams on data architecture decisions. Key Requirements Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing. Experience working with SQL and Python for data ingestion, ...
... dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania Minimum 6 lat komercyjnego doświadczenia w programowaniu w języku Python lub Go Doświadczenie w pracy z co najmniej jednym z narzędzi: Apache Airflow, Spark, Beam, NiFi, Flink Biegłość w SQL (PostgreSQL) i NoSQL - key-value, dokumentowe, ...
... enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities Build and maintain Python-based ETL/ELT workflows for data ingestion, ...