Opis oferty
B2Bnetwork
Poland, Warszawa
Senior Data Engineer - Scala / Spark / Hadoop (f/m) w Warszawa, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
We are looking for an experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes operating in a complex Big Data environment. Responsibilities: Design, develop and maintain Data Engineering solutions using Hadoop and Apache Spark. Build scalable solutions for processing large volumes of data. Analyse complex business requirements and translate them into effective technical solutions. Develop and optimise SQL queries and data-processing workflows. Build and enhance data pipelines and reporting processes. Create and maintain workflows using Apache Oozie and Apache Airflow. Develop data solutions using Scala. Work with event-driven architecture based on Apache Kafka. Maintain and improve CI/CD processes using Git, pull requests and Jenkins. Provide L3 support for production environments. Investigate production incidents and technical problems in cooperation with relevant operational teams. Collaborate with business stakeholders to define requirements and analyse issues. Ensure the quality, performance, security and reliability of data solutions. Requirements: Strong hands-on experience with Scala. Commercial experience with Apache Hadoop. Practical knowledge of Apache Spark and large-scale data processing. Experience building and maintaining Data Engineering pipelines. Experience with Apache Kafka and event-driven architecture. Practical knowledge of CI/CD processes, particularly Jenkins. Very good knowledge of Git, code review and pull request processes. Strong SQL development and optimisation skills. Experience supporting production environments. Ability to independently investigate complex technical issues. English proficiency sufficient for daily work in an international team. Availability to work from the Warsaw or Gdańsk office twice per week. Ability to perform the work from Poland. Nice to have: Kubernetes experience. Knowledge of Apache Flink. Experience with Apache Airflow or Apache Oozie. Previous involvement in regulatory or reporting projects. Experience in the financial sector. What we offer: Participation in a strategic regulatory initiative with a tangible impact on the financial sector. Work within a large and advanced Big Data environment. A modern technology stack including Scala, Hadoop, Spark, Kafka, Airflow and Jenkins. A high level of independence and influence over technical solutions. Cooperation with an experienced international team. Stable, long-term cooperation. A professional environment focused on quality, security and expert development. An opportunity to gain experience in financial regulations and regulatory reporting.
Podobne oferty
$2k USD
We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions ...
Poland, Warszawa
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
Poland, Łódź
... people in the world. Intellias is partnering with a Fortune 100, Midwest-based industrial manufacturer to modernize and expand a suite of cloud-based services and data products used by a global network of dealers, enterprise customers, and internal business units. Our cross-functional teams deliver scalable APIs, event-driven ...
Poland, Warząchewka Polska
Scalosoft
170 zł PLN
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
Poland, Kraków
8k
Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...
Poland, Warszawa
... implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments., Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy., Driving best practices in data engineering: quality assurance, lineage, ...
Poland, Warszawa
ASTRAL FOREST PROSTA SPÓŁKA AKCYJNA
1k zł PLN / year
Expected, Google Cloud Platform Data and Analytics, Python, dbt, Airflow, Terraform, GitHub Operating system, Windows About the project, We're looking for a senior Data Engineer who can step into an environment someone else built, work out how it really runs, and make it better. Most of our work is picking up existing platforms ...
Poland, Warszawa
20000 - 28000 zł
... OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers. Have a deep SQL and PySpark knowledge. Work ...
Poland, Warszawa
Hiberus Poland
1k - 4700
... dobre praktyki programistyczne. Współpraca z międzynarodowym, zwinnym zespołem. Job description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. ...
Poland, Wrocław
25200 - 30240 zł
... ensuring transparency, collaboration, and continuous improvement. Required skills: • 5 years of experience in Data Engineering. • Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse. • Advanced programming skills in Python, PySpark, and ...
Poland, Wrocław
Luxoft Poland, in partnership with DeGruyter Brill, is assembling a small senior team to develop a Cloud Platform. The goal is to start with a focused group and scale based on delivery performance and collaboration. Candidates should understand integrated systems, dig through log files, communicate clearly, and apply common ...
Poland, Warząchewka Polska
... 100% remote Language: English (fluent) Other: Occasional participation in an on-call rotation for the production platform. We are looking for highly skilled Senior Software Engineers to join an international engineering team building a production-grade financial technology platform used by leading financial institutions. ...
Poland, Warszawa
21000 - 28560 zł
... systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD. - Excellent understanding of dimensional data and data modeling techniques. ...
Poland, Poznań
$2k USD
... technical field 5+ years experience in software development with Big Data technologies Advanced knowledge of Python, Scala, or Java Proficient with Spark and Databricks and/or Snowflake Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services Demonstrated experience with big data models, ...
Poland, Poznań
$2k USD
... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...
Poland, Katowice
29400 - 33600 zł
For our Danish client, we're looking for a Senior Data Engineer to lead the migration of existing Airflow workflows to Azure Data Factory (ADF) and support the data layer behind our reporting solutions. The role is primarily focused on data engineering, ideally with a good understanding of Power BI and reporting environments. ...
Poland, Warszawa
$2k USD
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
Poland, Katowice
... direction you want. Responsibilities Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST API, flat files, Streams, Time series data, SAP Research and utilize Data Software Engineering technologies for effective data ingestion Process and transform data using tools such as Spark, Databricks ...
Poland, Poznań
Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models. Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming ...
Poland, Poznań