... ekosystemów Hadoop oraz systemów Object Store (np. VAST, MinIO). Rozwiązania typu Query Engine - znajomość przynajmniej jednej technologii platform takich jak: Dremio, Databricks, Denodo, Starburst. Analiza danych i podstawy Data Science - podstawowa wiedza z zakresu Data Science: znajomość metod eksploracyjnej analizy danych (EDA); ...
... firm-wide data strategy to govern, manage and engineer data as a product across more than 70 business-owned sub-domains. As part of this, they are migrating to Databricks as the foundational layer of their Enterprise Data Platform, adopting a lakehouse architecture built on open formats, declarative pipelines and Unity Catalog. ...
... writing data integrations, APIs (Python). Proved experience in data integration and orchestrating processes in Python. Requirements: Higher education in Computer Science, Mathematics / Statistics, Telecommunications or related. Ability to work with large amounts of data in an operational environment. Experience in data engineering ...
... windowing, segmentacja) i struktur danych zoptymalizowanych dla tysięcy eventów na sekundę Zbieranie, analiza i synteza wymagań od zespołów produktowych, analityków i Data Science. Propagowanie kultury data-driven w organizacji Tworzenie dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania ...
... looking for: Data Operations Specialist Responsibilities: Ingest data into Hadoop using the ARC Ingestion Framework Prepare configurations for onboarding new data sources Test configurations before production deployment Maintain and support data sources already running in production Troubleshoot ingestion and configuration ...
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
... through APIs, outbound interfaces, or is visualized via comprehensive reports and dashboards. Additionally, within our AI Center of Excellence, we undertake Data Science and Machine Learning projects with a focus on cutting‑edge areas such as Generative AI, Natural Language Processing (NLP), Anomaly Detection, and Computer ...
... pipelines, storage strategies, compute environments, and observability stacks—with a strong focus on self-service interfaces for AI engineers, analysts, and data scientists. This role requires combining deep technical expertise with strategic thinking, including support for feature engineering, unstructured data, and GenAI ...
... Description - Bachelor's degree in Computer Science or equivalent in the IT field with 10+ years of experience in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics ...
... stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity Sciences & Analytics odpowiada za budowę i rozwój strategicznego data lake’a oraz platformy analitycznej wspierającej bezpieczeństwo organizacji na skalę globalną. ...
... data platform solutions. In this role, you will act as a technical leader and solutions architect, driving automation strategies, API enablement, and modern data architectures such as Data Mesh. You will work closely with international, cross-functional teams to deliver scalable, secure, and cost-efficient data products ...
... beginning. With Hiberus, you can build a long-term career. Opis stanowiska Dla naszego klienta szukamy doświadczonego Senior Data Engineera do projektu z obszaru data engineering, skoncentrowanego na budowie i rozwoju skalowalnych rozwiązań chmurowych. Główne obowiązki : Projektowanie, rozwój i utrzymanie skalowalnych data ...
... min. B2+ , - stawka do 170 zł/h przy B2B w zależności od doświadczenia. Ta oferta jest dla Ciebie, jeśli: - posiadasz doświadczenie komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, ...
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
... reading. Your responsibilities, Design & Build, •Build and improve GCP data solutions using BigQuery, Cloud Composer, and Cloud Storage, •Build and maintain data pipelines and transformations with Python, dbt, and Airflow, •Model data across Data Warehouses, Lakehouses and Data Lakes within an established architecture, ...
... reports of data flow and data quality metrics, operational statuses, and catalog operationsGuide implementation team efforts in integration and harmonization of data from different sources, construction of analytical data products (including real-time streaming analytical data products) on its basis within the data platform, ...
O projekcie Dla naszego klienta, firmy z sektora bankowego realizującej nowoczesne projekty z obszaru Data & Technology, poszukujemy doświadczonego Data Platform Developera, który dołączy do zespołu rozwijającego skalowalną platformę danych opartą na architekturze event-driven. Szukamy osoby, która dobrze czuje się w świecie ...
... quantitative degree (Statistics, Operation Research, Systems Engineering, Computer Science, Applied Math, Economics), or Barchelor/Engineer degree with consecutive data science experience At least 4-5 years experience with production grade Data Science / algorithmically enabled applications Knowledge of Cloud Infrastructure: ...
... with customers, offering a vast product selection, fast delivery, and a well-crafted shopping experience. The role: Development and automation of tools in the Data Platform area Supporting the Client's product, technical, and analytical teams in building products, including technology solutions and data-driven services Assisting ...
... znajomość metod optymalizacji; - bardzo dobra znajomość zagadnień dotyczących baz danych; - praktyczna znajomość zagadnień przetwarzania w systemach klasy Big Data (Spark, Hadoop); - znajomość rozwiązań analitycznych i uczenia maszynowego dostępnych w chmurze (Azure, AWS). Co będzie należało do Twoich obowiązków: - praca ...