Opis oferty
B2Bnetwork
Poland, Warszawa
Senior Data Engineer - Scala / Spark / Hadoop (f/m) w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
We are looking for an experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using Hadoop and Apache Spark. Build scalable solutions for processing large volumes of data. Analyse complex business requirements and translate them into effective technical solutions. Develop and optimise SQL queries and data-processing workflows. Build and enhance data pipelines and reporting processes. Create and maintain workflows using Apache Oozie and Apache Airflow. Develop data solutions using Scala. Work with event-driven architecture based on Apache Kafka. Maintain and improve CI/CD processes using Git, pull requests and Jenkins. Provide L3 support for production environments. Investigate production incidents and technical problems in cooperation with relevant operational teams. Collaborate with business stakeholders to define requirements and analyse issues. Ensure the quality, performance, security and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. Practical knowledge of CI/CD processes, particularly Jenkins. Very good knowledge of Git, code review and pull request processes. Strong SQL development and optimisation skills. Experience supporting production environments. Ability to independently investigate complex technical issues. English proficiency sufficient for daily work in an international team. Availability to work from the Warsaw or Gdańsk office twice per week. Ability to perform the work from Poland. Nice to have: Kubernetes experience. Knowledge of Apache Flink. Experience with Apache Airflow or Apache Oozie. Previous involvement in regulatory or reporting projects. Experience in the financial sector. What we offer: Participation in a strategic regulatory initiative with a tangible impact on the financial sector. Work within a large and advanced Big Data environment. A modern technology stack including Scala, Hadoop, Spark, Kafka, Airflow and Jenkins. A high level of independence and influence over technical solutions. Cooperation with an experienced international team. Stable, long-term cooperation. A professional environment focused on quality, security and expert development. An opportunity to gain experience in financial regulations and regulatory reporting.
Podobne oferty
$2k USD
... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...
Poland, Katowice
Sii Poland is seeking an experienced Senior Data Engineer to design, develop, and maintain scalable data platforms that enable advanced analytics and global decision-making. You will contribute to a modern data platform used across markets, delivering high-quality, data-driven solutions at scale. You will implement Python-based ...
Poland, Rzeszów
Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models. Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming ...
Poland, Poznań
180 zł PLN - 500 zł PLN / hour
Working as a Senior AWS Data Engineer you will: Design and build robust data ingestion pipelines leveraging SP-API and Data Kiosk. Lead the seamless integration and complex mapping of SAP data into the central cloud ecosystem. Develop, optimize, and maintain highly efficient ETL/ELT workflows using AWS Glue. Implement and ...
Poland, Warszawa
... To be a good fit for the Senior Data Engineer Role, you will have: - 4+ years of hands‑on experience in data engineering, data transformation, or analytics engineering. - Strong proficiency in Python and SQL (familiarity with Scala is a nice-to-have). - Practical experience designing and maintaining data pipelines within ...
Poland, Warząchewka Polska
Jit Team is seeking an experienced Senior Data Engineer to join a project focused on building a modern reporting and data platform. You will work with multiple data sources and systems, integrating them into a central data warehouse and enabling business teams to access data via Power BI. The role requires 5+ years in Data ...
Poland, Warząchewka Polska
ERGO Technology & Services
... analysts and scientists, software engineers, and DevOps specialists to support the development of predictive models and business intelligence tools optimizing data processing workflows for performance, scalability, and reliability working in an international Scrum team Skills and experience you will need fluent spoken and ...
Poland, Warszawa
Nordea seeks an IT Developer/Data Engineer to advance data engineering for Capital and Credit Data Foundation. The role focuses on building scalable ELT/ETL pipelines, optimizing SQL/PLSQL, and implementing CI/CD for data infrastructure. Work spans on-prem and cloud in a hybrid environment across Poland and Finland. You ...
Poland, Gdynia
Phoenix Court Group
Phoenix Court Group is looking for an experienced software engineer specializing in large-scale data processing systems. You will be responsible for designing systems that handle billions of requests daily, improving application efficiency and scalability. With a minimum of 8 years’ experience in software development, proficiency ...
Poland, Kraków
ERGO Technology & Services
... settings strong understanding of software engineering, data engineering, and modern cloud development practices experience translating business requirements into scalable, maintainable technical solutions understanding of software quality attributes, including security, scalability, reliability, performance, and observability ...
Poland, Warszawa
... global analytics use cases. Your tasks Design, build, and optimize scalable data pipelines (batch & real-time) Develop and maintain ETL processes and integrate data from multiple sources (including migrations) Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL) Ensure data ...
Poland, Wrocław
Job Description: Data Engineer, LDWH Migration Programme Level: Senior / Mid-Senior Main Responsibilities: Develop and maintain data pipelines using Azure Databricks. Implement ETL processes, ensuring data quality and integrity. Read and comprehend complex SQL stored procedures. Translate architecture direction into engineering ...
Poland, Warszawa
McGregor Boyall
Data Engineers (Mid & Senior) — Krakow (Hybrid) Are you looking to work on modern, high-throughput data platforms without the legacy drag? We are scaling a dedicated Data Engineering team in Krakow to drive a major enterprise cloud consolidation onto a modern GCP & Medallion (Bronze/Silver/Gold) architecture. If you thrive ...
Poland, Kraków
... połączeń z systemami poza ekosystem CRM • implementacja mechanizmów kontroli jakości oraz walidacji danych Wymagania • Minimum 4-6 lat doświadczenia na stanowisku Data Engineer, preferencyjnie w sektorze o dużej skali danych • doświadczenie w projektowaniu i modelowaniu struktur danych (hurtownie danych, DataLake-ów) na potrzeby ...
Poland, Warszawa
23500 - 27000 zł
... roli Data Engineer lub podobnej. Doświadczenie komercyjne w pracy w środowisku AWS oraz technologiami Spark, Python i SQL. Praktyczna znajomość architektury Data Mesh oraz rozwiązań do przetwarzania dużych zbiorów danych. Doświadczenie w budowie skalowalnych i wysokowydajnych rozwiązań data engineeringowych w środowisku ...
Poland, Warszawa
Asana
3500 - 5040 zł
... Engineering. Degree in computer science, engineering or equivalent technical field experience. Proficient in cloud-based data processing and storage technologies like Databricks, Spark, Airflow. Fluent in SQL and proficient in at least one modern programming language (e.g., Python, Scala, Java). Proactive self-starter with a proven ...
Poland, Warszawa
... in Python. Requirements: Higher education in Computer Science, Mathematics / Statistics, Telecommunications or related. Ability to work with large amounts of data in an operational environment. Experience in data engineering for AI/ML solutions hosted on-prem or in the cloud (preferred GCP). Experience in Data Warehousing ...
Poland, Warszawa
... Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving. The role requires 5+ years in data integration, Python/SQL ...
Poland, Katowice
A leading global consulting firm seeks an experienced Google Data Engineer in Wrocław. In this role, you will design, build, and maintain scalable data platforms on Google Cloud, working closely with analytics teams to ensure data quality and performance. The company offers a hybrid working model, access to extensive training ...
Poland, Wrocław
$2k USD
We are seeking a Senior Platform Engineer to design and build the API and Gateway layer that unifies our Data & AI Platform, transforming a fragmented service landscape into one coherent, secure, and observable product. Responsibilities Design and build APIs and SDKs on top of distributed platform services using Python/FastAPIDefine ...
Poland, Katowice