... experience in Data Engineering or Software Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, ...
Data Modeller Kraków - hybryda 6 dni/ miesiąc z biura w Krakowie Opis stanowiska Jako Data Modeller będziesz odpowiedzialny/-a za projektowanie, wdrażanie i utrzymywanie modeli danych wspierających architekturę danych oraz inicjatywy analityczne organizacji. Będziesz współpracować z zespołami międzyfunkcyjnymi, aby zapewnić ...
... optymalizacji matematycznej, uczenia (nadzorowane, nienadzorowane, ze wzmocnieniem) oraz przetwarzania danych w czasie rzeczywistym. Skalowalne przetwarzanie Big Data & Cloud: Doświadczenie w pracy ze zbiorami danych o dużej skali przy użyciu SQL, Apache Spark/PySpark oraz infrastruktury chmurowej wraz z konteneryzacją. Silne ...
... chmurowe). - znajomość podstaw projektowania i zarządzania hurtowniami danych (Data Warehouse); - doświadczenie w implementacji i utrzymaniu środowisk Data Lake i Data Lakehouse. Bazy danych - zaawansowana znajomość przynajmniej jednej technologii bazodanowej w zastosowaniach BigData (od 1TB+) takich jak: PostgreSQL, Vertica, ...
... firm-wide data strategy to govern, manage and engineer data as a product across more than 70 business-owned sub-domains. As part of this, they are migrating to Databricks as the foundational layer of their Enterprise Data Platform, adopting a lakehouse architecture built on open formats, declarative pipelines and Unity Catalog. ...
... Warehousing and Business Intelligence. Good knowledge of common Python libraries and frameworks (Pandas, FastAPI, kubeflow pipelines, GCP libraries). Good knowledge of SQL databases, knowledge about noSQL would be an asset. Experience in working with Linux and Git version control system (GitLab). Knowledge of English at a level ...
... looking for: Data Operations Specialist Responsibilities: Ingest data into Hadoop using the ARC Ingestion Framework Prepare configurations for onboarding new data sources Test configurations before production deployment Maintain and support data sources already running in production Troubleshoot ingestion and configuration ...
... Our requirements - Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field. - Experience designing and implementing data models (conceptual, logical, physical). - Experience with relational databases (e.g., PostgreSQL, Lakebase). - Experience with lakehouse technologies (e.g., Databricks, ...
... skutecznego podejścia do Data Governance i Data Quality w całej organizacji. Twój zakres obowiązków - operacjonalizacja strategii i modelu działania Data Governance oraz Data Quality, - definiowanie ról i odpowiedzialności Data Ownerów, Data Stewardów oraz właścicieli procesów i systemów, ...
... ról Data Governance: Definiowanie i operacjonalizacja ról biznesowych (Data Owners, Data Stewards) w zespołach finansowych i operacyjnych Słownik biznesowy & Data Lineage: Tworzenie i rozwój jednolitego słownika pojęć biznesowych (Business Glossary) oraz mapowanie przepływu danych (Data Lineage) wspólnie z zespołami IT/Data ...
... migrating the Pricing team to a new target data platform. Work with technical teams on data architecture decisions. Key Requirements Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing. Experience working with SQL and Python for data ingestion, ...
... doświadczenia w programowaniu w języku Python lub Go Doświadczenie w pracy z co najmniej jednym z narzędzi: Apache Airflow, Spark, Beam, NiFi, Flink Biegłość w SQL (PostgreSQL) i NoSQL - key-value, dokumentowe, time-series oraz kolumnowe DWH Pisanie kodu wg zasad Clean Code (np. "Meaningful Variable and Function Names", ...
EPAM Campus offers a free Data Science training program to help you gain market-oriented hard and soft skills alongside IT professionals. In this intensive course, you will dive deep into statistics & data analysis, understand regression, classification and clustering techniques, as well as explore neural network basics. ...
... track to reach €1 billion in revenuethis year. Our Core Areas of Expertise Data & Technologies: We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI. Cloud & Application Services: We integrate leading platforms ...
... requirements Requirements 3+ years of hands-on data engineering experience. Strong Python programming skills with experience building ETL/ELT pipelines. Solid SQL skills, including query optimization and data modeling. Experience integrating data from OLTP databases, including PostgreSQL and Microsoft SQL Server Experience ...
... performance. - Collaborate with architects and analytics teams. - Automate deployments using CI/CD and infrastructure as code practices. Your Profile - Strong SQL and programming skills (Python, Scala). - Experience with BigQuery, Cloud Storage, Dataflow, Airflow. - Understanding of data modeling and distributed systems. ...
... such as Databricks Workflows, compute engines, including Spark, SQL, and Python, and storage strategies, including Delta Lake, ADLS, and Online Feature Stores Data Quality, Governance & Observability - establishing robust data quality monitoring, lineage tracking, metadata management, and anomaly detection processes - collaborating ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
EPAM Campus offers a free Data Science training program to help you gain market-oriented hard and soft skills alongside IT professionals. In this intensive course, you will dive deep into statistics & data analysis, understand regression, classification and clustering techniques, as well as explore neural network basics. ...
Infrastructure Data Engineer Dołącz do globalnego zespołu naszego klienta pracującego nad zaawansowaną platformą analityczną w obszarze cyberbezpieczeństwa na stanowisko Infrastructure Data Engineer. Lokalizacja: praca w modelu hybrydowym 6 dni na miesiąc z biura w Krakowie Współpraca: B2B O projekcie Zespół Cybersecurity ...