... and maintain scalable and efficient data pipelines in Azure and Databricks Develop and optimize ETL processes using Azure Data Factory and Databricks Build Big Data solutions aligned with business requirements Collaborate with Data Science, BI, and development teams to ensure high-quality data Monitor performance of data ...
EPAM Campus offers a free Data Science training program to help you gain market-oriented hard and soft skills alongside IT professionals. In this intensive course, you will dive deep into statistics & data analysis, understand regression, classification and clustering techniques, as well as explore neural network basics. ...
... data platform solutions. In this role, you will act as a technical leader and solutions architect, driving automation strategies, API enablement, and modern data architectures such as Data Mesh. You will work closely with international, cross-functional teams to deliver scalable, secure, and cost-efficient data products ...
... beginning. With Hiberus, you can build a long-term career. Opis stanowiska Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Główne obowiązki : Projektowanie, rozwój i utrzymanie skalowalnych data ...
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
... reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes within an established architecture, ...
... reports of data flow and data quality metrics, operational statuses, and catalog operationsGuide implementation team efforts in integration and harmonization of data from different sources, construction of analytical data products (including real-time streaming analytical data products) on its basis within the data platform, ...
O projekcie Dla naszego klienta, firmy z sektora bankowego realizującej nowoczesne projekty z obszaru Data & Technology, poszukujemy doświadczonego Data Platform Developera, który dołączy do zespołu rozwijającego skalowalną platformę danych opartą na architekturze event-driven. Szukamy osoby, która dobrze czuje się w świecie ...
We are looking for a passionate Senior Data Scientist who is eager to make an impact on their career and take on a new challenge! P&G Scaled Data Science Hub in Warsaw is dynamically growing and making impact across most key algorithmic investments of the Company. We work across problems and algorithmic products related ...
... contracts, loyalty programmes and flight schedules. As part of our modernization journey, we are migrating from Teradata to Databricks and building a modern, scalable data platform. This role offers the opportunity to influence architectural decisions, shape future data solutions and work with complex data ecosystems in an international ...
... with customers, offering a vast product selection, fast delivery, and a well-crafted shopping experience. The role: Development and automation of tools in the Data Platform area Supporting the Client's product, technical, and analytical teams in building products, including technology solutions and data-driven services Assisting ...
EPAM Campus offers a free Data Science training program to help you gain market-oriented hard and soft skills alongside IT professionals. In this intensive course, you will dive deep into statistics & data analysis, understand regression, classification and clustering techniques, as well as explore neural network basics. ...
... znajomość metod optymalizacji; - bardzo dobra znajomość zagadnień dotyczących baz danych; - praktyczna znajomość zagadnień przetwarzania w systemach klasy Big Data (Spark, Hadoop); - znajomość rozwiązań analitycznych i uczenia maszynowego dostępnych w chmurze (Azure, AWS). Co będzie należało do Twoich obowiązków: - praca ...
... środowisk multi-tenant. Definiowanie wzorców dostarczania danych z wykorzystaniem mikrousług i podejścia API-first (REST/GraphQL) oraz change data capture (Pub/Sub, Datastream). Projektowanie opartego na BigQuery hurtowni danych / Lakehouse, wspierającego zarówno przetwarzanie wsadowe (batch), jak i strumieniowe (Dataflow). Wdrażanie ...
... decision traceability by linking research, strategies and portfolio actions in a lineage graphIdentify and integrate structured, unstructured and semi-structured data sourcesDevelop logical data models and establish comprehensive data catalogs with metadata registrationImplement Role-Based Access Control (RBAC) and Property-Based ...
... potrzebuje solidnej warstwy danych i infrastruktury. Poszukujemy inżyniera, który ogarnia równie sprawnie bazę danych jak pipeline CI/CD - i rozumie, że w systemach czasu rzeczywistego infrastruktura jest równie krytyczna jak kod. Zakres obowiązków Redis - dane live i messaging Projektowanie i utrzymanie struktur Redis dla wysokoczęstotliwościowego ...
... join a project focused on building a modern reporting and data platform. You will work with multiple data sources and systems, integrating them into a central data warehouse and enabling business teams to access data via Power BI. The role requires 5+ years in Data Engineering, strong SQL and data warehouse skills, and hands-on ...
... job done designing and implementing data models and architectures that support financial data management developing and maintaining ETL processes to integrate data from diverse sources, including market data feeds, customer information systems, and transactional databases ensuring data quality, security, and compliance with ...
... Wrocławiu Stawka: do 130 zł/h netto na b2b Poszukujemy doświadczonego Project Managera do projektu związanego ze zmianą zasilania hurtowni danych oraz Cloud Data Lake danymi z nowo utworzonych domen biznesowych. Kluczowe jest doświadczenie w projektach migracji danych oraz budowy i zasilania hurtowni danych/CDL. Zakres ...
Data Engineer (K/M) Miejsce pracy: Warszawa Technologie, których używamy Wymagane - SQL - GCP - Big Data - Data Warehouse - Data Lake - ETL/ELT - Feature Store - Customer 360 - Golden Record - CRM O projekcie Cześć! Z tej strony Neontri - jesteśmy firmą liczącą ponad 120 osób. Specjalizujemy się w dwóch obszarach: ...