Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska
Poland, Warszawa
Data Engineer - Python, Spark & Cloud Data Pipelines w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
Join Unit8 SA in Warsaw, Poland, as a proficient Software Engineer. You will design, build, and maintain data pipelines and contribute to critical data & AI projects. This role involves collaborating with engineers and clients, requiring strong Python skills and a problem-solving mindset.
Enjoy a flexible work environment, a competitive compensation package, and opportunities for professional growth. Comprehensive benefits include private health care, 30 paid days off, and a supportive culture around training and teamwork.
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
... experience in Data Engineering or Software Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, ...
... amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing and Business Intelligence. Good knowledge of common Python libraries and frameworks (Pandas, FastAPI, kubeflow pipelines, GCP libraries). Good knowledge ...
... global analytics use cases. Your tasks Design, build, and optimize scalable data pipelines (batch & real-time) Develop and maintain ETL processes and integrate data from multiple sources (including migrations) Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL) Ensure data ...
We are looking for a Lead QA Automation Engineer with proven leadership experience in QA automation teams and strong experience with Big Data testing and distributed data validation. The role combines hands-on automation expertise in Python with team leadership, ensuring high-quality delivery across complex enterprise applications, ...
... enable efficient, data-driven quality engineering across multiple projects. Responsibilities Design and develop an enterprise test automation platform using Python, Selenium, SQL, and API testing frameworksBuild reusable automation libraries and integrate automated testing into CI/CD pipelinesDevelop AI-powered automation ...
We are looking for a Lead QA Automation Engineer with proven leadership experience in QA automation teams and strong experience with Big Data testing and distributed data validation. The role combines hands-on automation expertise in Python with team leadership, ensuring high-quality delivery across complex enterprise applications, ...
... enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. Responsibilities Build and maintain Python-based ETL/ELT workflows for data ingestion, ...
... technology and build a more sustainable, more inclusive world. Your Team Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across ...
... Proven leadership of engineering teams - Strong hands-on knowledge of modern data platforms such as Databricks - Experience with data pipeline orchestration, data modeling, data quality frameworks, and observability stacks - Familiarity with unstructured data processing and GenAI enablement pipelines is highly desirable ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...
... cloud-based data transformation Solid background in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing ...
... zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with ...
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
Expected, Python, SQL, Microsoft SQL Server, PostgreSQL Optional, Microsoft Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve ...
... colleagues ask to check their work, keep reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes ...
... years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work leveraging good practices of ...
... ubezpieczenie na życie Pełna odpowiedzialność za warstwę danych i infrastrukturę - realne decyzje architektoniczne Dostęp do konferencji i szkoleń z obszaru DevOps, data engineering i systemów rozproszonych Jak będzie wyglądać proces rekrutacji Aplikacja – po otrzymaniu CV wracamy z informacją zwrotną Rozmowa wstępna (HR) – wzajemne ...
... exemplary projects: Petabyte-scale data platform migration to Google Cloud Migration of 1,000+ active pipelines to GCP. Rearchitecture of Spark applications to Cloud Dataproc or BigQuery SQL. Automation with Cloud Composer. Data analytics platform for an investing company Azure-based data platform with Databricks as the central ...