Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering ...
... Composer/Airflow, Cloud Run) and Kafka. Modern Transformation & Architecture: Implementing dbt models and Medallion patterns to enable trusted self-service analytics across global business units. Data Quality & Governance: Setting up data contracts, lineage tracking, and observability tools in a high-scale environment. ...
... Python, PySpark Twój zakres obowiązków, audytowanie i tworzenie projektów procesów raportowania danych sprzedaży online dla Erste Bank Polska w oparciu o platformę Databricks,, optymalizacja obecnych kodów PySpark pod kątem jakości i funkcjonalności,, tworzenie i optymalizacja zaawansowanych procesów przetwarzania danych na platformie ...
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
... analytical apps and projects; data preparation; identifying patterns from data by analyzing it; insights generation for real-life business challenges, using BI and Data Discovery tools; data visualization, preparation of BI dashboards; conducting unit tests; supporting in-app preparation and maintenance; ensuring data quality ...
The Data Engineering team’s mission is to ensure high-quality data to enable data-informed decision-making across Asana. You will build data artifacts that are leveraged by a wide range of stakeholders in the marketing domain, and create frameworks and tooling used by all data and analytics engineering teams. In this role, ...
... inspiruje. Tworzymy, testujemy, wprowadzamy zmiany tam, gdzie mają sens. Budujemy rzeczy od zera i szukamy nowych rozwiązań. Brzmi dobrze? Dołącz do nas na stanowisko Data Scientist i razem z nami buduj przyszłość Internetu! Jakie działania będą należeć do Ciebie? Projektowanie i wdrażanie modeli ML rozwiązujących problemy biznesowe: ...
... changes, performance optimization and managing large-scale data operations and migrations. This role combines hands-on operational work with growth into broader data engineering responsibilities, giving you the opportunity to influence platform reliability, support analytics and drive key projects across the organization. ...
... and solving problems together Our requirements - At least 5-6 years of experience working as a Data Engineer, with a focus on Google Cloud Platform Data and Analytics. - Strong hands-on experience with Python, dbt, and Airflow - Solid working knowledge of BigQuery and the wider GCP data stack - Experience in data modelling, ...
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Kafka, NiFi, Docker, and Iceberg. - Excellent understanding of dimensional data and data modeling ...
... least 5 years of experience in data project management; knowledge of Agile methodologies would be an advantage, Strong proficiency with BI tools (e.g., Power BI Datasets, Databricks, Tableau, SAP, Business Objects); Super User profile, Solid data analysis and financial modelling skills, Deep understanding of management accounting/controlling ...
Senior Data Engineer Miejsce pracy: Kraków Recruitment for Our client is an Israeli sports-tech company combining advanced data engineering, AI/ML and mathematical modelling to build high-performance real-time sports analytics solutions. The company processes large volumes of real-time data across sports including football, ...
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
... Strong experience with data storages, with a mandatory focus on SQL Server., Proficiency in database programming using SQL, PL/SQL, or T-SQL., Solid experience in data modeling., Hands-on experience with Kafka and APIs., Proven track record of building ETL/Data Pipelines and a deep understanding of various data technologies., ...
... and develop scalable data pipelines using Azure, Databricks, Python and PySpark. - Use Databricks AI tooling and Spark-based processing to extract and process data from typed and handwritten insurance documentation. - Clean, validate, transform and model data for machine learning, analytics and BI use cases. - Build reliable ...
... projekcie, Wspólnie z naszym Partnerem, jednym z europejskich liderów w branży bankowej, poszukujemy doświadczonego/ej specjalisty/ki do realizacji projektów jako Big Data Engineer., , Projekt realizowany jest w obszarze bankowości B2B i B2C, w domenie C-Profit odpowiedzialnej za konsolidację i udostępnianie zespołom sprzedaży transakcji ...
... level or higher., Graduated with a degree in Mathematics, Computer Science, Economics, Physics (or similar quantitative field) or have early-career experience in Data Science / Data Analytics positions. What we offer, Well-located offices (with e.g. fully equipped kitchens, bicycle parking, terraces full of greenery) and excellent ...
... analytics to optimize ITIL processes (e.g., incidents, problems, changes) - Collaborate with IT and business teams to define reporting requirements and KPIs - Ensure data quality, documentation, and compliance with data governance policies - Monitor ETL/ELT processes and automate data pipelines in MS Fabric - Explore new data sources ...
... product - you focus on product development - you focus on code maintenance - agile - scrum Your responsibilities - Support the critical GKYC program by driving data analytics, design, and development. - Work with data taxonomies and build small data models. - Produce clear, actionable reports using Power BI. - Work closely ...