Remote Data Engineer — AWS Data Lake & ETL Specialist… - Jobeax
Opis oferty
Remote Data Engineer — AWS Data Lake & ETL Specialist w Warszawa, Polska
ASTEK Polska Sp. z o.o.
ZdalniePraca z dowolnego miejsca
Warszawa, Polska
Astek Polska sp. z o.o. poszukuje Data Engineera do pracy nad projektami dla sektora farmaceutycznego w Warszawie. Rola obejmuje projektowanie i rozwijanie skalowalnych architektur danych, tworzenie hurtowni danych i Data Lake, a także implementację złożonych procesów ETL/ELT w środowisku AWS.
Wymagana jest praktyczna wiedza z zakresu Big Data, baz danych oraz optymalizacji wydajności systemów. Oferujemy długoterminową współpracę i pakiet benefitów.
... Prefect). - Exposure to CI/CD pipelines and DevOps practices. - Knowledge of streaming technologies (e.g., Kafka, Spark Streaming). - Experience working with Snowflake or Databricks in a production or development environment. - Relevant certifications in AWS, data engineering, or big data technologies. WHAT YOU’LL LOVE ABOUT ...
... typically touch: • Data Warehouse / Data Lakehouse architectures on AWS alongside streaming and batch pipelines, • Apache Iceberg as the open table format, • Data Warehouses and query engines: DuckDB, Amazon Redshift, Amazon Athena, Amazon S3 Tables, Snowflake, ClickHouse, and other AWS-native data services, • Airflow (AWS ...
... typically touch:, •Data Warehouse / Data Lakehouse architectures on AWS alongside streaming and batch pipelines,, •Apache Iceberg as the open table format,, •Data Warehouses and query engines: DuckDB, Amazon Redshift, Amazon Athena, Amazon S3 Tables, Snowflake, ClickHouse, and other AWS-native data services,, •Airflow (AWS ...
... wydajność i jakość inżynierską. - Współpraca z architektami, Product Ownerami, Business Analyst. Nasze wymagania - Min. 4-5 lat doświadczenia komercyjnego w roli Data Engineer, Cloud Data Engineer lub Data Platform Engineer. - Zaawansowana znajomość ekosystemu AWS, w szczególności: Lambda, DynamoDB, RDS, S3, Glue, Kinesis, ...
... within AWS cloud environments using cloud-native patterns - Build and optimize ETL/ELT workflows to support analytical and operational use cases - Implement data modeling strategies aligned with modern data lakehouse architectures - Ensure data quality, governance, and monitoring across all data assets - Deliver secure, ...
... store, including historical backfill – Experience building pipelines feeding an LLM / retrieval system — strong plus – Experience handling sensitive personal data in a regulated or security-sensitive environment – Comfortable being the only data engineer on a small (2.5-FTE) pod, at part-time allocation, without hand-holding ...
... szkoleniowym oraz w projektach komercyjnych i PoC, pod opieką doświadczonych mentorów. W zależności od wybranej ścieżki, rozwój w jednym z dwóch kierunków: Data Engineering: przetwarzanie danych z wykorzystaniem technologii takich jak Snowflake, Databricks i SQL oraz praca w środowiskach Azure, AWS, Google Cloud. Data Science: ...
Expected, Python, SQL, Microsoft Azure, ETL/ELT, CI/CD, Data Engineering Optional, LLM, RAG, Generative AI, Databricks Operating system, Windows, macOS About the project, As a Data Engineer, you will play a key role in the development of our AI-powered chatbot. Working primarily from a data engineering perspective, you ...
... Participate in production support as part of the team. 2+ years of experience in Data Engineering., Strong Python and SQL skills., Hands-on experience building ETL/ELT/data pipelines., Experience with PySpark., Experience with at least one cloud platform (Azure or GCP)., Experience working with Databricks or another modern data processing ...
... monitoring standards - Support data-related incidents and ensure timely resolution of issues Requirements: - Minimum 3 years of experience in Data Engineering, Data Warehousing, or BI Development - Strong SQL skills and experience with relational databases - Hands-on experience with Azure Data Factory or another ETL/ELT platform ...
- Minimum 5 years of commercial experience in data engineering with Google Cloud - Google Cloud Professional Data Engineer certification (expected or to be obtained within the first month of work). - Advanced knowledge of the Google Cloud ecosystem: BigQuery, Cloud Storage, Pub/Sub, BigTable, Dataflow, Dataproc, Cloud Functions/Run, ...