... Design, develop, and maintain scalable data pipelines Build and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needs Implement data ingestion from multiple sources (databases, APIs, files, messaging/ event streams) Perform data transformation, validation, and quality checks across end‑to‑end ...
... technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions. Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well as batch and streaming processing. Knowledge of data quality, governance, cataloguing ...
... data engineering and data modelingPalantir Foundry expertise with hands-on development experienceProficiency in PySpark and Python programmingExperience with data connection for APIs and external transformsKnowledge of data quality principles and ontology designProficiency in English at a B2+ level Nice to have Experience ...
... Minimum 4 lata doświadczenia jako Data Engineer - Bardzo dobra znajomość Python, - Praktyczne doświadczenie z PySpark, - Doświadczenie z Azure, - Znajomość Azure Databricks, - Bardzo dobra znajomość SQL, - Doświadczenie w budowaniu i utrzymywaniu data pipelines, - Doświadczenie w transformacji i przetwarzaniu danych, - Znajomość ...
- Databricks experience - Pyspark - SQL - Batch processing - Streaming - Workflows - Unity Catalog - DevOps/Streaming experience - SQL Server experience as desirable We are looking for a Senior Data Engineer to join the SML Warehouse Management Stable Team in a key replacement assignment. In this role, you will work in ...
... 10+ lat doświadczenia w obszarach Data Engineering, Data Architecture, AI lub Machine Learning. Doświadczenie w projektowaniu i implementacji enterprise-scale Data & ML platforms na Microsoft Azure. Znajomość: Azure Data Factory Azure Databricks Azure Synapse Analytics Azure Data Lake Storage Azure Machine Learning Azure ...
... offers a unique opportunity to collaborate with dynamic, cross-location teams and contribute to shaping the product vision. Senior Developer (T SQL / Java / Data Flows) Responsibilities: Perform impact analysis of changes and ensure consistency with the existing architecture Define and specify data flows, including technical ...
... segmentations and machine learning solutions - Strong understanding of statistics, exploratory data analysis, feature engineering and model evaluation - Experience with data mining processes, data preparation and data scraping - Ability to work with messy, real-world business data and convert it into useful analytical outputs - Experience ...
... with Liquid Clustering. - Register curated data products in Unity Catalog with the correct tags, masks, row filters, lineage and access policies. - Implement data quality gates at the Silver-to-Gold boundary, and refine rules with domain stewards. - Package and deploy work using Databricks Asset Bundles through Azure DevOps ...
... Warsaw is seeking a Senior Solution Architect with over 7 years of experience. The role involves collecting business needs, designing architectures, and ensuring quality deliverables. Key qualifications include technical expertise, fluent English, and knowledge of data integration. The position offers a hybrid working model ...
... squads. Your day-to-day mission: · Coach teams in Agile principles, practices and metrics · Collaborate with the Product Owners to manage backlogs - with good data quality - and realign priorities if needed. · Identify and support in resolving team impediments · Facilitating squad ceremonies to support/develop/improve squad ...
... oraz procesów CI/CD, umiejętność tworzenia dokumentacji technicznej, doświadczenie w pracy w metodykach Agile. Mile widziane: Dataform, doświadczenie w budowie hurtowni danych, Angular, platformy Low-Code/No-Code, doświadczenie w środowisku produkcyjnym lub przemysłowym, znajomość zagadnień Data Governance i Data Quality.
... relevant key performance indicators (KPIs), standard reports, and ad-hoc analyses based on our Customer Data Platform. You work in close coordination with our Data Engineering team to design the required analysis datasets. Process Automation: You transform manual queries and data preparation tasks into automated pipelines ...
... high-quality engineering standards: Git-based workflows, code reviews, automated tests, documentation, and reproducibility. Ensure monitoring and traceability: data/feature drift checks, model and prompt versioning, cost/latency tracking, and structured logging. Partner cross-functionally with Product, Data Engineers, AI ...
... with Liquid Clustering. - Register curated data products in Unity Catalog with the correct tags, masks, row filters, lineage and access policies. - Implement data quality gates at the Silver-to-Gold boundary, and refine rules with domain stewards. - Package and deploy work using Databricks Asset Bundles through Azure DevOps ...
... broader data ecosystem (data, platform, analytics teams) Support testing and monitor search performance, accuracy, and usability Prepare analytical reports on data availability and search effectiveness Requirements 3 years + of experience as a Data Engineer, including exposure to large-scale or Big Data environments Strong ...
... will be responsible for maintaining and evolving the Microsoft Fabric platform, ensuring a stable, scalable, and cost-efficient environment. You will manage data pipelines, enhance architecture, and deliver high-quality data models following the medallion (bronze, silver, gold) approach. Your tasks Own and continuously ...
... meet business objectives and user expectations. - Drive continuous improvement of ERM platforms, identifying opportunities to improve functionality, efficiency, data quality, and user experience. - Coordinate with technology teams, architects, and delivery partners to support successful solution design, development, testing, ...
Veeam is seeking a Customer Success Engineer to lead onboarding, adoption, and optimization across the Veeam Data Platform. You’ll be the primary technical owner driving long-term customer outcomes, including DR/R simulations, resilience reporting, and migrations. You’ll collaborate with CISO/CIO stakeholders, shape adoption ...
HeadHR w Warszawie poszukuje specjalisty w obszarze Consulting IT, który zajmie się rozwojem funkcjonalności AI oraz optymalizacją kodu PySpark i Python. Wymagana jest biegła znajomość PySpark, Python, SQL, oraz doświadczenie w Generative AI i pracy z chmurą Azure.