Remote Data Engineer — AWS Data Lake & ETL Specialist… - Jobeax
Opis oferty
Remote Data Engineer — AWS Data Lake & ETL Specialist w Warszawa, Polska
ASTEK Polska Sp. z o.o.
ZdalniePraca z dowolnego miejsca
Warszawa, Polska
Astek Polska sp. z o.o. poszukuje Data Engineera do pracy nad projektami dla sektora farmaceutycznego w Warszawie. Rola obejmuje projektowanie i rozwijanie skalowalnych architektur danych, tworzenie hurtowni danych i Data Lake, a także implementację złożonych procesów ETL/ELT w środowisku AWS.
Wymagana jest praktyczna wiedza z zakresu Big Data, baz danych oraz optymalizacji wydajności systemów. Oferujemy długoterminową współpracę i pakiet benefitów.
... Prefect)., Exposure to CI/CD pipelines and DevOps practices., Knowledge of streaming technologies (e.g., Kafka, Spark Streaming)., Experience working with Snowflake or Databricks in a production or development environment., Relevant certifications in AWS, data engineering, or big data technologies. What we offer, Practical ...
... typically touch: • Data Warehouse / Data Lakehouse architectures on AWS alongside streaming and batch pipelines, • Apache Iceberg as the open table format, • Data Warehouses and query engines: DuckDB, Amazon Redshift, Amazon Athena, Amazon S3 Tables, Snowflake, ClickHouse, and other AWS-native data services, • Airflow (AWS ...
... Creating and maintaining data import/export processes., Preparing documentation and continuously learning business aspects. At least 2 years of experience in databases and ETL., Strong SQL knowledge (procedural database languages such as T-SQL, PL/SQL)., Experience with Databricks., Experience with version control tools., ...
... szkoleniowym oraz w projektach komercyjnych i PoC, pod opieką doświadczonych mentorów. W zależności od wybranej ścieżki, rozwój w jednym z dwóch kierunków: Data Engineering: przetwarzanie danych z wykorzystaniem technologii takich jak Snowflake, Databricks i SQL oraz praca w środowiskach Azure, AWS, Google Cloud. Data Science: ...
... visualization tools (e.g., Power BI, Tableau)., Knowledge of machine learning, predictive analytics, and statistical modeling techniques., Experience with cloud-based data and analytics platforms (Azure, AWS)., Microsoft Data & AI, Azure Data Engineer, Power BI, or similar analytics certifications are an advantage. What we offer, ...
... services to deliver ultra-low latency, high-throughput data solutions, •Build aggregation layers and pipelines consumed by APIs, AI/ML models, and dashboards, , Data Engineering & Integration, •Expose time-series and analytics data through API gateways and integration layers, •Collaborate closely with data science and AI teams ...
... visualization tools (e.g., Power BI, Tableau). - Knowledge of machine learning, predictive analytics, and statistical modeling techniques. - Experience with cloud-based data and analytics platforms (Azure, AWS). - Microsoft Data & AI, Azure Data Engineer, Power BI, or similar analytics certifications are an advantage. What we offer ...
... services to deliver ultra-low latency, high-throughput data solutions, •Build aggregation layers and pipelines consumed by APIs, AI/ML models, and dashboards, , Data Engineering & Integration, •Expose time-series and analytics data through API gateways and integration layers, •Collaborate closely with data science and AI teams ...
... Participate in production support as part of the team. 2+ years of experience in Data Engineering., Strong Python and SQL skills., Hands-on experience building ETL/ELT/data pipelines., Experience with PySpark., Experience with at least one cloud platform (Azure or GCP)., Experience working with Databricks or another modern data processing ...
... requirements - Bachelor’s degree in Computer Science, Engineering, or related field - Proven experience as a Data Engineer or similar role - Strong knowledge of data processing technologies and database systems (SQL, NoSQL) - Experience with data pipeline and workflow management tools (e.g., Apache Airflow, ETL) - Proficiency ...
... Participate in production support as part of the team. 2+ years of experience in Data Engineering., Strong Python and SQL skills., Hands-on experience building ETL/ELT/data pipelines., Experience with PySpark., Experience with at least one cloud platform (Azure or GCP)., Experience working with Databricks or another modern data processing ...