Opis oferty
B2Bnetwork
Poland, Warszawa
Senior Data Engineer - Scala / Spark / Hadoop (f/m) w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
We are looking for an experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using Hadoop and Apache Spark. Build scalable solutions for processing large volumes of data. Analyse complex business requirements and translate them into effective technical solutions. Develop and optimise SQL queries and data-processing workflows. Build and enhance data pipelines and reporting processes. Create and maintain workflows using Apache Oozie and Apache Airflow. Develop data solutions using Scala. Work with event-driven architecture based on Apache Kafka. Maintain and improve CI/CD processes using Git, pull requests and Jenkins. Provide L3 support for production environments. Investigate production incidents and technical problems in cooperation with relevant operational teams. Collaborate with business stakeholders to define requirements and analyse issues. Ensure the quality, performance, security and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. Practical knowledge of CI/CD processes, particularly Jenkins. Very good knowledge of Git, code review and pull request processes. Strong SQL development and optimisation skills. Experience supporting production environments. Ability to independently investigate complex technical issues. English proficiency sufficient for daily work in an international team. Availability to work from the Warsaw or Gdańsk office twice per week. Ability to perform the work from Poland. Nice to have: Kubernetes experience. Knowledge of Apache Flink. Experience with Apache Airflow or Apache Oozie. Previous involvement in regulatory or reporting projects. Experience in the financial sector. What we offer: Participation in a strategic regulatory initiative with a tangible impact on the financial sector. Work within a large and advanced Big Data environment. A modern technology stack including Scala, Hadoop, Spark, Kafka, Airflow and Jenkins. A high level of independence and influence over technical solutions. Cooperation with an experienced international team. Stable, long-term cooperation. A professional environment focused on quality, security and expert development. An opportunity to gain experience in financial regulations and regulatory reporting.
Podobne oferty
$2k USD
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
Poland, Warszawa
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
Poland, Łódź
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Warszawa
The HEINEKEN Company
... Team, see our office, and much more? Visit our website: Heineken ( The Senior Data Engineer is accountable for leading globally and collaborating with regional data engineering teams to design, deliver, and continuously improve high-quality, scalable, and reusable enterprise data products and services. These services form ...
Poland, Kraków
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
Poland, Wrocław
8k
Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...
Poland, Warszawa
Hiberus Poland
1k - 4700
... dobre praktyki programistyczne. Współpraca z międzynarodowym, zwinnym zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. ...
Poland, Wrocław
Scalosoft
170 zł PLN
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
Poland, Kraków
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
Poland, Warszawa
ASTRAL FOREST PROSTA SPÓŁKA AKCYJNA
1k zł PLN / year
Expected, Google Cloud Platform Data and Analytics, Python, dbt, Airflow, Terraform, GitHub Operating system, Windows About the project, We're looking for a senior Data Engineer who can step into an environment someone else built, work out how it really runs, and make it better. Most of our work is picking up existing platforms ...
Poland, Warszawa
20000 - 28000 zł
... OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work ...
Poland, Warszawa
Luxoft Poland, in partnership with DeGruyter Brill, is assembling a small senior team to develop a Cloud Platform. The goal is to start with a focused group and scale based on delivery performance and collaboration. Candidates should understand integrated systems, dig through log files, communicate clearly, and apply common ...
Poland, Warząchewka Polska
$2k USD
... technical field 5+ years experience in software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, ...
Poland, Kraków
21000 - 28560 zł
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
Poland, Poznań
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Katowice
$2k USD
We are looking for a Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud ...
Poland, Wrocław
... optimization, IT systems design, implementation, maintenance, and business application development. We are looking for a Senior Data & AI Engineer who combines strong data engineering skills with a customer-oriented and advisory mindset . In this role, you’ll work closely with our customers to understand their business and data ...
Poland, Warząchewka Polska
$2k USD
We are looking for a Senior Data Engineer (Python, AWS) to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud ...
Poland, Kraków
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Łódź