BigData Engineer (Python or Scala + Spark) w… - Jobeax
Opis oferty
BigData Engineer (Python or Scala + Spark) w Warszawa, Polska
Warszawa, Polska
BigData Engineer (Python or Scala + Spark)
We are looking for a skilled BigData Engineer to join an exciting project for a leading banking client , one of the top players in the Polish market. You will work on building and improving Big Data solutions that support key business processes, using modern technologies and best engineering practices.
It's a Warsaw-based opportunity. The team visit the office once in two weeks.
Responsibilities:
Write and maintain data pipelines and applications using Python or Scala
Work with Apache Spark and other Big Data tools to process large amounts of data
Use data warehouse principles to keep data well-structured and reliable
Follow good engineering practices: clear code, proper testing, documentation, and clean design
Handle different data formats like JSON, Parquet, ORC, and Avro
Write and improve SQL queries to work with data efficiently
Combine data from different sources into a single system
You will be perfect candidate if you have:
Minimum 3 years of experience in Python or Scala programming
Commercial experience and exposure to BigData technologies, Spark is a must
Familiarity with Data Warehouse principles
Knowledge of good engineering practices, Big Data processing, including Design standards, Data Modelling techniques, coding, documentation, testing and implementation
Experience with various data formats: JSON, PARQUET, ORC, AVRO
Understanding database types and usage scenarios, e.g. Hive, Kudu, HBase, Iceberg, etc.
Advanced knowledge of SQL Experience in integrating data from multiple data sources
Knowledge of tools for building projects/applications, e.g. Maven
Advanced knowledge of Polish and good knowledge of English
It will be a strong plus to have:
Practical knowledge of Agile processes and tools: Jira, Confluence, Kanban, Scrum, etc.
Knowledge of the Kubeflow platform
Knowledge of streaming technologies and tools such as Kafka, Apache Nifi
Junior Scala Engineer Miejsce pracy: Kraków Technologies we use Expected - Java - Scala - Apache Kafka - SQL - noSQL - Claude Code - Cursor - GitHub Copilot About the project Synerise is looking for a Junior Scala Engineer - to design, build, and evolve backend for event processing and analytics platform that powers AI-driven ...
... solution using a mix on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow. Are programming in languages such as Scala or Java, Python, Have strong understanding of distributed systems, data storage, and processing framework like dbt, Spark or Apache Beam, Have knowledge of GCP ...
... systems and enabling long-term scalability. - Access to workspace at Warsaw Centre Point: The hub offers modern facilities including showers, breakout zones, outdoor space, cycle parking, and refreshments (coffee, soft drinks, and fruit). #ENGINEERING ,[At HelloFresh we are moving away from a model where software developers ...
... maintainable software Professional software development experience in Python and/or Java., Experience developing and maintaining backend applications and REST APIs., For Java development: familiarity with Spring Boot and common application-development practices., For Python development: familiarity with modular application design, ...
... Databricks, Apache Spark, SQL, Delta Lake Optional, Python, Scala, Java, Azure DevOps, Azure Event Hubs, Kafka, Azure Pureview About the project, We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients. This is how we work, in house, you have ...
... design and deliver data solutions - Monitoring code quality and conducting continuous integration Our requirements - Minimum 4 years of experience as a Data Engineer working on projects involving large-scale data processing - Strong knowledge of Scala and Apache Spark - Practical experience with Java and developing backend ...
... Engineering with exposure to Gen AI/ML-based applications - Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala - Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives - Expertise in AWS cloud environments and cloud-native ...
... Doświadczenie w pracy jako fullstack engineer. Szukasz miejsca, w którym Twoja praca naprawdę ma znaczenie? W CloudFerro tworzymy technologie, z których na co dzień korzystają europejscy liderzy nauki i sektora kosmicznego - m.in. ESA, EUMETSAT, ECMWF, Mercator Ocean International, DLR czy EGI. Pracując blisko sektora Earth Observation ...
... responsible for its day-to-day execution., Continuously improving development velocity while maintaining a very high reliability standard. 10+ years of experience in Python development., Previous experience as a Staff or Principal Engineer at a startup company., Previous leadership experience, including leading teams and driving ...
... day-to-day execution. - Continuously improving development velocity while maintaining a very high reliability standard. Our requirements - 10+ years of experience in Python development. - Previous experience as a Staff or Principal Engineer at a startup company. - Previous leadership experience, including leading teams and driving ...
... the project, We are currently looking for a Senior Python AI Engineer to join the team of our client, a prominent organization in the enterprise and banking sector., , In this role, you will be building a Tech Modernisation Framework: an innovative, AI-driven solution designed to analyze legacy code repositories and rewrite ...