Opis oferty

Senior Data Software Engineer (Python, GCP) w Warszawa, Polska

EPAM Systems (Poland) sp. z o.o.

Warszawa, Polska

2 dni temu

Your responsibilities

Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP
Research and utilize Big Data technologies for effective data ingestion
Process and transform data using tools such as Spark and various Cloud Services
Understand and execute project-specific business logic through programming languages supported by the primary data platform
Optimize data retrieval, develop dashboards, and perform data validation
Collaborate with diverse teams including data scientists, analysts, and IT professionals
Provide thought leadership on Big Data best practices and technology trends
Maintain and ensure integrity and security of big data sources and platforms
Perform troubleshooting, debugging, and upgrading of big data systems and applications

Bachelor’s degree in Computer Science, Mathematics or related technical field
5+ years experience in software development with Big Data technologies
Advanced knowledge of Python, Scala, or Java
Proficient with Spark and Databricks and/or Snowflake
Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services
Demonstrated experience with big data models, databases, and tools
Strong understanding of different data file formats like JSON, Parquet, Avro
Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB
Proficiency in data warehousing solutions, ETL processes
Proven ability to work within a fast-paced, team-oriented environment
Detail-oriented with excellent analytical and problem-solving skills
Knowledge of software development methodologies and best practices
Exceptional oral and written communication skills in English (B2+)

Experience with Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN
Experience with message queues, especially Kafka
Production experience in search technologies such as Solr, OpenSearch, or Lucene

Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
English language classes
Stable income (Employment Contract or B2B)
Participation in the Employee Stock Purchase Plan
Benefits package (health insurance, multisport, shopping vouchers)
Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
Referral bonuses
Corporate, social and well-being events

Ładowanie podobnych ofert…