Data Engineer (BigQuery / GCP) (m/f/d) w Łódź, Polska
Commerzbank AG
ZdalniePraca z dowolnego miejsca
KontraktUmowa czasowa lub freelancing
Łódź, Polska
Your responsibilities
Develop and optimize BigQuery datasets, views and queries (partitioning, clustering, materialized views) to meet performance and cost targets.
Build and maintain ELT/ETL pipelines into BigQuery (e.g., via Cloud Storage, Pub/Sub, Dataflow, Dataproc, or vendor sources), including monitoring and error handling.
Model data for analytics (dimensional and/or data vault concepts) and define data quality checks, lineage and documentation for curated datasets.
Collaborate with business and IT stakeholders to translate requirements into technical specifications, implement changes, and support testing and release activities.
Ensure operational stability and security (IAM, service accounts, dataset access, auditability), troubleshoot incidents, and continuously improve reliability and automation.
Our requirements
Advanced SQL skills with hands-on experience in BigQuery
... Data Quality executions., Supporting technical and business testing activities., Contributing to technical and operational documentation., Working closely with Data Modelers, Business Analysts, and Test Engineers.] Requirements: Data pipelines, ETL, SQL, Data migration, System integration, GCP, BigQuery, dbt Additionally: ...
... security and data governance practices, including IAM and DLP,, working with Dataplex for data management and governance,, collaborating with stakeholders and engineering teams to deliver reliable data solutions.] Requirements: PySpark, GCP, CI/CD, BigQuery, IAM, Apache Airflow, Python, DLP, dbt, Lakehouse Additionally: Training ...
... obowiązków, projektowanie i rozwój rozwiązań Data Engineering w Google Cloud Platform, migracja i przebudowa procesów przetwarzania danych z Oracle/on-premise do GCP, projektowanie i rozwój procesów batch oraz streaming, projektowanie struktur i modeli danych w BigQuery, tworzenie i optymalizacja zapytań SQL, analiza i modyfikacja ...
... standardów i modeli danych. 3–5 lat doświadczenia w środowisku GCP na stanowisku Data Engineer lub Data Governance Engineer., 3–5 lat doświadczenia w obszarze Data Governance, Data Management lub Data Quality., Praktyczna znajomość GCP - szczególnie w kontekście BigQuery, Dataplex i Data Catalog., Zaawansowana znajomość ...
... Edenred, Arabian Drilling, FedEx, Leroy Merlin, Truecaller, Volotea, Schmitz Cargobull, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing. ,[design, ...
... danych. Nasze wymagania - 3–5 lat doświadczenia w środowisku GCP na stanowisku Data Engineer lub Data Governance Engineer. - 3–5 lat doświadczenia w obszarze Data Governance, Data Management lub Data Quality. - Praktyczna znajomość GCP - szczególnie w kontekście BigQuery, Dataplex i Data Catalog. - Zaawansowana znajomość ...
... Composer, Apache Airflow, Dataproc, Dataflow, Datastream, BigQuery Dataform, Cloud Storage, Cloud Run, Terraform, IAM Mile widziane, SAP Datasphere / SAP BDC, Azure Databricks, dbt, Google Cloud Professional Data Engineer O projekcie, Poszukujemy Konsultanta IT specjalizującego się w Google Cloud Platform (GCP), który będzie odpowiedzialny ...
Expected, GCP, BigQuery, Python, Apache Airflow, ETL, Power BI, SQL About the project, We are looking for an experienced Senior Data Engineer to join our team and work on innovative data engineering projects. You will play a key role in building and maintaining data pipelines, implementing data orchestration workflows, ...
- Minimum 5 years of experience in data engineering and working with cloud-based data platforms - Strong expertise in Google Cloud Platform (GCP), particularly BigQuery - Proficiency in Python and SQL for data manipulation and analysis - Hands-on experience with Apache Airflow for data orchestration - Familiarity with Power ...