Senior Big Data Engineer (Databricks + AWS) w… - Jobeax
Opis oferty
Senior Big Data Engineer (Databricks + AWS) w Polkowice, Polska
Poland, Polkowice
Senior Big Data Engineer (Databricks + AWS) w Polkowice, Polska is listed on Jobeax. Browse 110,000+ vacancies available.
~4+ years of experience in Big Data or Data Engineering ~ Strong proficiency in Python (PySpark) and SQL ~ Hands-on experience with AWS cloud services for data engineering solutions ~ Practical experience with Databricks on AWS , including building and managing...
Phoenix Court Group is looking for an experienced software engineer specializing in large-scale data processing systems. You will be responsible for designing systems that handle billions of requests daily, improving application efficiency and scalability. With a minimum of 8 years’ experience in software development, proficiency ...
DCG Poland is looking for experienced professionals to develop distributed BigData processing pipelines. Candidates should have 7+ years of expertise in Spark and Scala, along with substantial experience in Python and Robot Framework. You will collaborate with DevOps and QA teams in an Agile environment, maintaining a focus ...
... experience with Azure Data Factory (ADF) pipelines proficiency in incremental and full data loads familiarity with CI/CD integration for data workflows knowledge of Databricks and Python for advanced data processing strong grasp of dimensional modeling and schema design experience implementing Change Data Capture (CDC) in production ...
... data mesh, data virtualization, agentic architectures and more). Qualification HERE’S WHAT YOU’LL NEED: Hands‑on experience with implementing solutions with data lakes and pipelines (Databricks, Azure Data Factory). Proven experience in designing and implementing solutions in Azure cloud (knowledge of AWS, GCP will be ...
... architecture over quick fixes. We don't just maintain pipelines; we solve complex architectural challenges. About the Role Entrada AI, Inc. is seeking an experienced Senior Machine Learning Engineer (Databricks) to join our growing team of consultants. In this role, you will be responsible for designing, developing, and deploying ...
... and maintain scalable and efficient data pipelines in Azure and Databricks Develop and optimize ETL processes using Azure Data Factory and Databricks Build Big Data solutions aligned with business requirements Collaborate with Data Science, BI, and development teams to ensure high-quality data Monitor performance of data ...
... contracts, loyalty programmes and flight schedules. As part of our modernization journey, we are migrating from Teradata to Databricks and building a modern, scalable data platform. This role offers the opportunity to influence architectural decisions, shape future data solutions and work with complex data ecosystems in an international ...
... Learning, Data Engineering, Big Data, or advanced software systems. - Strong understanding of the software development lifecycle (SDLC) and practical exposure to engineering environments. - Previous experience in a consulting company, AI/data-focused organization, or software house. - Demonstrated experience working with large, ...
... windowing, segmentacja) i struktur danych zoptymalizowanych dla tysięcy eventów na sekundę Zbieranie, analiza i synteza wymagań od zespołów produktowych, analityków i Data Science. Propagowanie kultury data-driven w organizacji Tworzenie dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania ...
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
... Are a Good Candidate If You Have - 7-10 years of experience in data engineering, platform development, and/or large-scale data systems - Proven leadership of engineering teams - Strong hands-on knowledge of modern data platforms such as Databricks - Experience with data pipeline orchestration, data modeling, data quality ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
Contract type: B2B Rate: no fixed rate, dependent on candidate’s experience Mode: 100% remote from Poland We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions. ...
... description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with AWS: Glue, ...
... min. B2+ , - stawka do 170 zł/h przy B2B w zależności od doświadczenia. Ta oferta jest dla Ciebie, jeśli: - posiadasz doświadczenie komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, ...
... Azure, Google Cloud Platform, AWS, Databricks, Apache Spark, PySpark, Apache Airflow, GitHub Actions, Terraform, Bicep About the project, At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve large-scale Big Data and cloud-native platforms for global clients, including ...
... Data Engineer, with a focus on Google Cloud Platform Data and Analytics., Strong hands-on experience with Python, dbt, and Airflow, Solid working knowledge of BigQuery and the wider GCP data stack, Experience in data modelling, integration and security, with Terraform, GitHub and CI/CD as everyday tools, Strong problem-solving ...
... resolving issues reported through organizational communication channels (Slack, email, OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, ...
... Computer Science, Engineering, or related field At least 5 years of experience in Data Engineering with a strong ETL background Hands-on experience with Azure Data Factory, Azure Databricks, Azure SQL, ADLS Proficiency in Python, Scala, or Java and strong SQL skills Experience with big data frameworks, CI/CD, and Agile methodologies, ...