Over 3 years of experience in Data Engineering and building production-scale data platforms.
Strong programming skills in Python and SQL.
Advanced experience with data modeling, ETL development, and multiple data formats.
Strong knowledge of Google Cloud Platform and cloud-native architecture design.
Expert knowledge of Apache Airflow for workflow orchestration and automation.
Hands-on experience with Apache Spark for batch and high-volume streaming workloads.
Good understanding of CI/CD and DevOps tools such as GitHub Actions or Kubernetes.
Nice to Have
Experience with MLOps and ML deployment in production, preferably with Vertex AI.
Practical experience with Terraform for Infrastructure as Code.
Experience building scalable REST APIs for data or ML services.
Strong testing practices, including TDD and unit/integration tests for Spark and Airflow.
Knowledge of Scala for high-performance data processing.
Data Engineer
We’re looking for an experienced Data Engineer to build, scale, optimize, and maintain reliable data platforms. You’ll work on real-time pipelines, ML infrastructure, attribution data processing, and cloud-native solutions in a high-volume production environment.
Tech Stack
GCP
Apache Spark, dbt, BigQuery
Python, SQL, Scala
Apache Airflow
Terraform, GitHub Actions, Docker, Kubernetes
VertexAI
,[Build and maintain large-scale advertising data pipelines for clicks, impressions, attribution, and event processing. , Improve attribution modeling logic to support better optimization and business decisions. , Ensure high availability, performance, stability, and scalability of real-time data workflows. , Design and support production-grade ML model serving infrastructure., Develop and manage dbt datasets for model training, experimentation, and Feature Store integration. ] Requirements: Google Cloud Platform, ETL, Airflow, Python, SQL, Spark, DevOps, CI/CD, Kubernetes, MLOps, AI, Scala, REST API, Terraform, VertexAI Additionally: Sport subscription, Training budget, Private healthcare, Flat structure, Small teams, International projects.
... technology and build a more sustainable, more inclusive world. Insights and Data: Insights & Data is a dynamic team of over 400 professionals delivering cutting-edge data solutions. We specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across GCP, Azure and AWS. Our expertise spans the full ...
... engineering, BI, and data owners. - Support development teams in defining data contracts. Qualifications Must-have requirements: - Experience with Google Cloud Platform (GCP). - Minimum of 4-5 years of practical experience in Data Engineering, Data Governance, Data Quality, data analysis, or related fields, including experience in ...
... solution design; - ● helping clients modernize their data platforms and move away from legacy solutions. Our requirements - at least 3-4 years of experience in data engineering; - practical experience with at least one cloud platform: GCP or Azure; - hands-on experience with at least one of the following: BigQuery, Snowflake ...
... with real-time streaming data solutions (e.g., Kafka Streams, Kinesis). - Knowledge of machine learning pipelines and data science workflows. - Familiarity with data governance and compliance frameworks (e.g., GDPR, CCPA). - Certification in AWS, GCP, or Azure. - Academic background in Computer Science, Data Engineering, or ...
Expected, GCP, BigQuery, Python, Apache Airflow, ETL, Power BI, SQL About the project, We are looking for an experienced Senior Data Engineer to join our team and work on innovative data engineering projects. You will play a key role in building and maintaining data pipelines, implementing data orchestration workflows, ...
... definitions and semantic models with technical implementations. - Assess and improve data quality controls, implement monitoring and remediation guidance for data issues. - Work alongside data engineers and implementation teams to deliver efficient, scalable and secure data solutions on GCP. - Advise on GCP security controls, ...
Your responsibilities - Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP - Research and utilize Big Data technologies for effective data ingestion - Process and transform data using tools such as Spark and various Cloud Services ...
... will be shared during the recruitment process. Our requirements - Bachelor’s degree in Computer Science, Engineering, or related field - Proven experience as a Data Engineer or similar role - Strong knowledge of data processing technologies and database systems (SQL, NoSQL) - Experience with data pipeline and workflow management ...
... występujących podczas ich przetwarzania,, współpracę z zespołem projektowym odpowiedzialnym za rozwój architektury danych oraz rozwiązań chmurowych opartych o GCP,, wykorzystywany stos technologiczny: Google Cloud Platform (GCP), BigQuery, Kubernetes, SQL, Data Lake, ETL/ELT, Big Data, Real-Time Processing, Feature Store,, ...
Your responsibilities - Experience in data science, engineering, and data analysis. - Experience leveraging SQL and Python (dataframes) for data pipeline orchestration, file ingestion, data cleansing, data joining and relationships, data aggregation, data manipulation, and data analysis to create meaningful informed results ...