... years in data engineering, with real unstructured / semi-structured work (not only warehouse modelling) – Demonstrated experience integrating many third-party APIs into one coherent store, including historical backfill – Experience building pipelines feeding an LLM / retrieval system — strong plus – Experience handling sensitive ...
9000 - 22000 zł
... maintain scalable data pipelines using Python, SQL and PySpark., Develop data ingestion and transformation processes., Work with cloud-based data platforms and Databricks., Integrate data from multiple operational systems., Build data products that support aviation operations and decision-making., Work with APIs and data ...
Gdańsk, Polska
Zobacz ofertę... currently establishing a new IT Competence Center in Kraków, we are looking for a Data Engineer. In this role, you will be responsible for building and maintaining data pipelines and warehouse objects for a new Microsoft Dynamics 365-based data platform, while ensuring the stable operation of legacy data warehouses during the ...
Kraków, Polska
Zobacz ofertę- Hybrydowo
- Pełny etat
- Kontrakt
14000 zł
... technical mentor for the team through pair programming, setting technical standards, and conducting code reviews.] Requirements: Google cloud, BigQuery, CI/CD, Git, Data engineering, Google Cloud, Cloud, Storage, PUB, IAM, CD pipelines, GitHub Actions, Infrastructure as Code, Terraform, SQL, Python, Clean Code, Communication skills, ...
Warszawa, Polska
Zobacz ofertę14000 - 18000 zł
... maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark., Working with raw data and designing methods for its integration into the data platform., Developing CI/CD pipelines for data engineering solutions., Creating and maintaining Infrastructure as Code solutions., Integrating the data platform ...
Katowice, Polska
Zobacz ofertę- Zdalnie
- Hybrydowo
- Stacjonarnie
- Kontrakt
20833 - 30000 zł
About you - 3+ years of hands-on experience in Data Engineering or Software Engineering. - Degree in computer science, engineering or equivalent technical field experience. - Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. - Fluent in SQL and proficient in at least one ...
Warszawa, Polska
Zobacz ofertę160,00 – 200,00 zł
Your responsibilities - Design, develop, and maintain scalable batch and real-time data pipelines using modern data engineering technologies. - Build and optimize data processing solutions leveraging Apache Spark, Kafka, and distributed computing frameworks. - Develop and manage data warehousing solutions using Apache Hive ...
Warszawa, Polska
Zobacz ofertę17 601 – 22 399 zł
... środowiska bazodanowego Oracle do Google Cloud Platform, z wykorzystaniem BigQuery, Pub/Sub oraz Cloud Storage, - projektowanie, implementację i rozwój rozwiązań Data Engineering na platformie GCP, w szczególności z wykorzystaniem BigQuery, Cloud Storage i Pub/Sub, - migrację oraz przebudowę procesów przetwarzania i zasilania ...
Warszawa, Polska
Zobacz ofertę28 000 – 32 000 zł
... queries and services to deliver ultra-low latency, high-throughput data solutions - • Build aggregation layers and pipelines consumed by APIs, AI/ML models, and dashboards - - Data Engineering & Integration - • Expose time-series and analytics data through API gateways and integration layers - • Collaborate closely with data ...
Kraków, Polska
Zobacz ofertę- Hybrydowo
- Stacjonarnie
- Kontrakt
... integracyjne, plikowe, API oraz strumieniowe, m.in. Kafka - POC nowych narzędzi i technologii do potencjalnego wdrożenia w HD PZU, w tym rozwiązań SAS Viya, Oracle Exadata, Microsoft Fabric, Power BI oraz narzędzi automatyzujących pracę zespołu - Budowa narzędzi monitorujących aktywność użytkowników HD oraz wspierających kontrolę ...
Warszawa, Polska
Zobacz ofertę