... requirements - 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications - Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala - Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives ...
... of experience as a Data Engineer working on projects involving large-scale data processing - Strong knowledge of Scala and Apache Spark - Practical experience with Java and developing backend applications or data processing solutions - Experience designing and implementing ETL/ELT processes and data pipelines - Good knowledge ...
Expected, Microsoft Fabric, Python, SQL, Apache Spark, Azure Data Factory, Azure Data Lake Storage, Databricks About the project, We are looking for an experienced Data Engineer with Microsoft Fabric to join our Data & Analytics Competence Center – a specialized unit bringing together top experts in data engineering, data processing, ...
... data engineering. - Strong expertise in one or more cloud platforms: AWS , GCP , or Azure . - Proficiency in programming languages like Python , SQL , or Java/Scala . - Hands-on experience with big data tools such as Hadoop , Spark , or Kafka . - Experience with data warehouses like Snowflake , BigQuery , or Redshift . - ...
... Airflow . Wspólnie z naszym Partnerem, jednym z europejskich liderów w branży bankowej, poszukujemy doświadczonego/ej specjalisty/ki do realizacji projektów jako Big Data Engineer . Projekt realizowany jest w obszarze bankowości B2B i B2C , w domenie C-Profit odpowiedzialnej za konsolidację i udostępnianie zespołom sprzedaży ...
... uzgodnionym w ramach realizacji zlecenia. - Projektowanie i wdrożenie rozwiązań do zbierania, transformacji i przetwarzania dużych zbiorów danych, z wykorzystaniem Spark, Java, Hive i SQL. - Job'y przetwarzania i mapowania danych zrealizowane z użyciem Spark/Scala, dostarczone zgodnie z wymaganiami biznesowymi. - Analiza danych ...
... experience implementing, developing, or maintaining Big Data systems, data governance and data management processes., Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design., Hands-on with Big Data technologies like Spark, Cloudera, Kafka, Data Platform, Airflow, NiFi, Docker, and Iceberg., Excellent ...
... Synapse, and Azure Data Factory, Developing and maintaining data pipelines, notebooks, dataflows, and transformation processes, Supporting the development of scalable lakehouse, warehousing, and analytics solutions, Collaborating with Data Architects, Senior Data Engineers, and customer engineering teams, Implementing engineering ...
... Our requirements - Proven experience as a Data Engineer / Spark Developer in big data or cloud ecosystems. - Strong knowledge of Apache Spark, especially in data processing and ETL pipeline development. - Hands on experience with MongoDB and ODS type data store architectures. - Practical experience in Data Lakehouse technologies ...
... consistency in data operations, Staying updated with industry trends and best practices in data engineering and cloud technologies Minimum 5 years of experience in data engineering and working with cloud-based data platforms, Strong expertise in Google Cloud Platform (GCP), particularly BigQuery, Proficiency in Python and SQL ...
... consistency in data operations, Staying updated with industry trends and best practices in data engineering and cloud technologies Minimum 5 years of experience in data engineering and working with cloud-based data platforms, Strong expertise in Google Cloud Platform (GCP), particularly BigQuery, Proficiency in Python and SQL ...