At least 3+ years of experience in big data engineering.
Proficiency in Scala and experience with Apache Spark .
Strong understanding of distributed data processing and frameworks like Hadoop.
Experience with message brokers like Kafka .
Hands-on experience with SQL/NoSQL databases.
Familiarity with version control tools like Git .
Solid understanding of data architecture and ETL processes.
Good command of English.
Nice to Have
Experience with cloud platforms such as AWS , Azure , or GCP .
Knowledge of containerization tools like Docker and orchestration with Kubernetes .
Familiarity with CI/CD pipelines for big data workflows.
Experience in optimizing Spark jobs for large-scale data processing.
Academic background in Computer Science, Data Engineering, or a related field.
At Link Group, we specialize in building tech teams for Fortune 500 companies and some of the world's most exciting startups. Our mission is to connect talented professionals with opportunities that align with their skills, interests, and career aspirations.
We are currently looking for a Big Data Engineer with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.
About the Project
The project focuses on building a high-performance data platform for the finance/stock exchange industry , processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency.
Tech Stack
Scala
Apache Spark
Hadoop ecosystem (HDFS, Hive, HBase)
Kafka
SQL/NoSQL databases
Cloud platforms (AWS, Azure, GCP)
Docker, Kubernetes
Agile development methodologies
What We Offer
Tailored opportunities to match your professional interests and goals.
A leadership role in a dynamic and collaborative work environment.
Access to exciting and diverse projects for global clients.
Competitive compensation aligned with your expertise.
Ongoing opportunities for professional growth and development.
Apply today and join us at Link Group to make an impact!
,[Design, implement, and optimize big data processing pipelines using Scala and Spark., Work with massive datasets, ensuring scalability and performance., Collaborate with data scientists and analysts to develop data solutions., Monitor and troubleshoot data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, Kubernetes, CI/CD Pipelines Tools: Agile, Scrum.
... proponowanie działań naprawczych, Praca hybrydowa - 3 dni w tygodniu z Warszawy (WARUNEK KONIECZNY), Stawka: do 200 zł netto + VAT/H/B2B Min. 4 lata doświadczenia w Big Data Engineering (mile widziane doświadczenie w bankowości), Bardzo dobra znajomość: Spark, Java, SQL, Hive, Znajomość narzędzi i technologii: (mile widziane) ...
... Airflow . Wspólnie z naszym Partnerem, jednym z europejskich liderów w branży bankowej, poszukujemy doświadczonego/ej specjalisty/ki do realizacji projektów jako Big Data Engineer . Projekt realizowany jest w obszarze bankowości B2B i B2C , w domenie C-Profit odpowiedzialnej za konsolidację i udostępnianie zespołom sprzedaży ...
Expected, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Databricks, Apache Spark, SQL, Delta Lake Optional, Python, Scala, Java, Azure DevOps, Azure Event Hubs, Kafka, Azure Pureview About the project, We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
Expected, Python, SQL, Spark, Airflow, AWS, Cloudera, Iceberg Optional, Kubernetes, Kafka, NiFi, Trino, Hudi, Java, Scala, Docker, Databricks About the project, As a Senior Data Engineer (Spark), you will join a complex data engineering project focused on building and developing scalable data pipelines and modern data processing ...
... Our requirements - Proven experience as a Data Engineer / Spark Developer in big data or cloud ecosystems. - Strong knowledge of Apache Spark, especially in data processing and ETL pipeline development. - Hands on experience with MongoDB and ODS type data store architectures. - Practical experience in Data Lakehouse technologies ...
... Design architectures and patterns for processing and storing large-scale, high‑volume event data. - Build backend software with a strong focus on performance, scalability, and reliability. - Translate complex functional and technical requirements into robust system designs. - Work with large datasets to ensure data correctness ...
... Exposure to CI/CD pipelines and DevOps practices., Knowledge of streaming technologies (e.g., Kafka, Spark Streaming)., Experience working with Snowflake or Databricks in a production or development environment., Relevant certifications in AWS, data engineering, or big data technologies. What we offer, Practical benefits: ...
... Engineer and Databricks Certified Data Engineer - Proficiency in Python, Java or Scala - Hands-on experience with MS Cloud SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, Power BI, SSIS and SSRS - Strong SQL skills and experience with relational databases - Familiarity with big data technologies ...