Senior Python Data Scraping Engineer (Freelance) w… - Jobeax
Opis oferty
Senior Python Data Scraping Engineer (Freelance) w Poznań, Polska
Mindrift
ZdalniePraca z dowolnego miejsca
Część etatuMniej godzin w tygodniu
KontraktUmowa czasowa lub freelancing
40 $ / stawka godzinowa
Poland, Poznań
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
... we use Expected - SQL - Python About the project As a Senior Database Engineer, you will be responsible for designing, optimizing and scaling high-performance database infrastructure supporting millions of transactions and real-time data flows. You will work with transactional databases, document databases, Kafka-based streaming ...
Expected, Google Cloud Platform, Terraform, Git, GitHub Actions, SQL, Python Optional, Docker, Kubernetes About the project, We are looking for a Senior Data Engineer who will act as a technical mentor, define our architecture, and bring best practices to our Google Cloud ecosystem. You will step away from the daily grind ...
... of strategic initiatives., , Opportunity Overview, As a Senior Data Engineer, you will play a key role in designing, building, and scaling our clients’ cloud data platforms. You’ll work closely with technical and business stakeholders, influence architecture decisions, and drive best engineering standards across teams., ...
... Microsoft SQL Server, SQL, PL/SQL, T-SQL, Kafka Optional, Snowflake, AWS S3 Operating system, Windows About the project, We are currently looking for a Senior Data Engineer to join our client, a dynamically growing company in the banking industry. In this role, you will be responsible for building and optimizing data pipelines, ...
Senior Data Engineer Miejsce pracy: Gdańsk Technologies we use Expected - Databricks - Apache Spark - Python - PyTorch - Microsoft Azure Optional - Pytest About the project We are looking for a skilled Data Engineer to join an international technology and data team on a 6-month engagement, starting in the first or second ...
Expected, SQL, T-SQL, Python, Apache Spark, Databricks, Delta Lake, Azure Data Factory, C#, Microsoft Azure Optional, Microsoft Power BI About the project, Senior Data Engineer role focused on end-to-end data engineering in modern cloud architectures, bridging business needs with technical solutions. Join agile product ...
Wymagane, Databricks, Python, PySpark Mile widziane, Microsoft Fabric, Azure Synapse, Microsoft Power BI, Snowflake Data Cloud, BigQuery, Microsoft Azure O projekcie, Jako Senior Data Engineer dołączysz do jednego z naszych zespołów rozwijających produkty cyfrowe dla klientów z Europy Północnej, stawiając na jakość oraz ...
Senior Data Engineer Location: Wrocław - 2 days in office / 3 days remote Let us introduce you the job offer by EY GDS Poland – a member of the global integrated service delivery center network by EY. The opportunity We are building an innovative team responsible for analyzing ITIL process data and supporting business decision-making ...
... from architecture to deployment, collaborating with a modern, high‑performing engineering team. What makes you a great fit: - 5+ years of professional data engineering experience - 2+ years working with programmatic advertising or ad-tech data - Strong proficiency in Python and SQL - Experience with streaming data platforms ...
... migrating the Pricing team to a new target data platform. Work with technical teams on data architecture decisions. Key Requirements Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing. Experience working with SQL and Python for data ingestion, ...
... windowing, segmentacja) i struktur danych zoptymalizowanych dla tysięcy eventów na sekundę Zbieranie, analiza i synteza wymagań od zespołów produktowych, analityków i Data Science. Propagowanie kultury data-driven w organizacji Tworzenie dokumentacji oraz proponowanie nowych rozwiązań i kierunków dalszego rozwoju Nasze wymagania ...
We are looking for a Senior Data Engineer to support the design, development, and enhancement of our client’s enterprise data platform. The ideal candidate is a hands-on data engineer with strong experience building data pipelines, integrating data from operational databases, and working with modern cloud data warehouses. ...
... Team, see our office, and much more? Visit our website: Heineken ( The Senior Data Engineer is accountable for leading globally and collaborating with regional data engineering teams to design, deliver, and continuously improve high-quality, scalable, and reusable enterprise data products and services. These services form ...
... in a similar role - Hands-on experience with SQL, Databricks, Python (advanced) - Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics - Hands-on usage of AI in engineering SDLC. - Experience with Big Data, Data Warehouse, and Data Lake ...
... in Data Engineering and DataOps practices Experience designing and consuming RESTful APIs Strong knowledge of CI/CD pipelines (e.g. Jenkins) Proficiency in Python for automation and integration Experience with Snowflake and modern cloud data warehouses Practical experience implementing or supporting Data Mesh architectures ...
... description For our client we are looking for an experienced Senior Data Engineer to join a project focused on building and developing scalable, cloud-based data solutions. Responsibilities Design, develop, and maintain scalable data pipelines. Build reusable and configurable Python modules. Work hands-on with AWS: Glue, ...
... komercyjne na stanowisku Data Engineer, - pracowałeś z chmurą publiczną (AWS i/lub GCP i/lub Azure), - masz praktyczne doświadczenie z Apache Airflow, - znasz Databricks i ekosystem Spark, - swobodnie poruszasz się w SQL oraz jednym z języków programowania (Python/Scala), - potrafisz pracować samodzielnie w środowisku rozproszonym. ...
... of strategic initiatives., , Opportunity Overview, As a Senior Data Engineer, you will play a key role in designing, building, and scaling our clients’ cloud data platforms. You’ll work closely with technical and business stakeholders, influence architecture decisions, and drive best engineering standards across teams., ...
Expected, Google Cloud Platform Data and Analytics, Python, dbt, Airflow, Terraform, GitHub Operating system, Windows About the project, We're looking for a senior Data Engineer who can step into an environment someone else built, work out how it really runs, and make it better. Most of our work is picking up existing platforms ...
... resolving issues reported through organizational communication channels (Slack, email, OpsGenie) Job requirements At least 5 years of commercial experience in data engineering. Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%). Know about Google Cloud Platform (BigQuery, Composer, Dataproc, ...