Data Engineer - Batch and Streaming Pipelines w Polkowice, Polska
Pełny etatStandardowy tygodniowy wymiar godzin
KontraktUmowa czasowa lub freelancing
Poland, Polkowice
If you have 8-10 years of experience building and operating distributed data pipelines and are looking to advance your career working with modern data technologies, this contract role offers the opportunity to make a direct impact on their data infrastructure. Contract Type: Contract. Competitive contract rate reflecting your experience and expertise. Contract flexibility with potential for extension based on performance
SQL
Pełny etat
... cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive on handling genuinely complex data pipelines, event streaming, and laying the pipeline foundation for future ML & AI workloads, this is for you. What you’ll be doing: Pipeline Engineering: Building & optimizing batch and real-time ...
ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in ...
... and autonomous culture. ,[Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability., Design and implement data pipelines that process large volumes of data in both streaming and batch modes., Optimize data workflows to ensure efficient data ingestion, processing, ...
... and autonomous culture. ,[Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability., Design and implement data pipelines that process large volumes of data in both streaming and batch modes., Optimize data workflows to ensure efficient data ingestion, processing, ...
... passionate about modern data engineering, AI-assisted development, and creating impactful data solutions, don't hesitate to apply! Your responsibilities, Design and develop data solutions using Databricks, Python, and PySpark, Build and optimize ETL/ELT pipelines for batch and streaming data processing, Implement and maintain ...
... clients. Depending on the project, your work may include: designing, building and optimizing data pipelines in GCP and/or Azure; working with BigQuery, Snowflake or Databricks; using Python or JVM languages such as Java or Scala; working with SQL in complex data environments; developing scalable batch and streaming data processing ...
... the data transformation and following data ops pipelines for global car manufacturer. This project aims to build a data processing system for both real-time streaming and batch data. We’ll handle data for business uses like process monitoring, analysis, and reporting, while also exploring LLMs for chatbots and data analysis. ...
... the data transformation and following data ops pipelines for global car manufacturer. This project aims to build a data processing system for both real-time streaming and batch data. We’ll handle data for business uses like process monitoring, analysis, and reporting, while also exploring LLMs for chatbots and data analysis. ...
... Addepto. ,[Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability., Design and implement data pipelines that process large volumes of data in both streaming and batch modes., Optimize data workflows to ensure efficient data ingestion, processing, and storage ...
... we engineer solutions that support Nordea's transformation and enable the Customer Vision and Business Strategy. - We are looking for experienced GCP Cloud Engineers to join our Data Mesh and AI Platforms team. You will help deliver secure, automated, and reusable GCP infrastructure and platform capabilities in close collaboration ...
... architects, cybersecurity, data governance, risk and compliance, cloud platform teams, and consuming engineering teams to ensure our solutions are pragmatic, compliant, and production-ready. You will be expected to bring strong hands-on engineering experience with API platforms and gateways, combined with solid knowledge of Terraform, ...
... audience recommendations using the Teads Data Suite. - Training: Work with Global Data Teams to create and deliver training programs for all new data products and solutions built by Teads. - Product Feedback: Provide actionable feedback to the Teads Product Management and Engineering departments regarding future data needs ...
... Science, Economics, or engineering or equivalent experience · Results oriented with strong analytical and problem-solving skills, with demonstrated intellectual and analytical rigor · Hands-on experience with one or more data analytics/programming tools such as R/Python · Hands-on experience with SQL databases · Experience ...
... Kernel, and LlamaIndexAI / ML Operations: Proven experience with MLOps / LLMOps pipelines, evaluation frameworks, feedback loops, vector databases, and embedding pipelinesData Platforms: Hands-on familiarity with Databricks and Snowflake, ETL/ELT pipelines (both batch and streaming processing), data modeling, and semantic layersAnalytics ...
... Kernel, and LlamaIndexAI / ML Operations: Proven experience with MLOps / LLMOps pipelines, evaluation frameworks, feedback loops, vector databases, and embedding pipelinesData Platforms: Hands-on familiarity with Databricks and Snowflake, ETL/ELT pipelines (both batch and streaming processing), data modeling, and semantic layersAnalytics ...
... Kernel, and LlamaIndexAI / ML Operations: Proven experience with MLOps / LLMOps pipelines, evaluation frameworks, feedback loops, vector databases, and embedding pipelinesData Platforms: Hands-on familiarity with Databricks and Snowflake, ETL/ELT pipelines (both batch and streaming processing), data modeling, and semantic layersAnalytics ...
... into effective data modelling https://jobeax.com/link/nGdefD578X04jN8a data profiling and analysis on relational and hierarchical data sources, including JSON and XML https://jobeax.com/link/d879mD0gLNBrNwo5 closely with data architects and engineers to ensure models support data transformation and high-quality data https://jobeax.com/link/y4uaV3zu22twrDv0 ...
... depth in backend engineering. - Hands-on experience with microservices and micro-database architecture. - Experience with event-driven systems . - Expert in Java and Spring Framework (Boot/Data/REST/Security/Profiles). - Front-end experience with ReactJS and TypeScript (able to contribute meaningfully; backend-led). - API ...
... the data transformation and following data ops pipelines for global car manufacturer. This project aims to build a data processing system for both real-time streaming and batch data. We’ll handle data for business uses like process monitoring, analysis, and reporting, while also exploring LLMs for chatbots and data analysis. ...
... DevOps About the project The project migrates data and reporting from a legacy estate onto a modern platform built on Databricks and Microsoft Fabric. Quality engineering is central to the project. The business needs confidence that migrated data reconciles with the source, that pipelines behave as specified, and that reports ...