AI Pilot, Web Scraping Specialist

Job Description: AI Pilot, Web Scraping Specialist at Braintrust

This opportunity is for candidates currently residing in a specified country, as location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.

Mindrift is actively seeking highly skilled Vibecode specialists to join the Tendem project. In this role, referred to as an AI Pilot, you will drive specialized data scraping workflows within a unique hybrid AI + human system. You will collaborate with Tendem Agents handling repetitive tasks, while providing critical thinking, domain expertise, and quality control to ensure accurate and actionable results.

This part-time remote opportunity is perfect for technical professionals with hands-on experience in web scraping, data extraction, and processing.

What We Do

The Mindrift platform connects specialists with cutting-edge AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by leveraging real-world expertise from a global talent pool.

About The Role

As a freelance Vibe Code specialist on the Tendem project, you will manage data scraping tasks requiring technical precision for web extraction and processing. You will utilize various tools, including provided platforms like Apify and OpenRouter, in conjunction with your own resourceful approaches.

Key Responsibilities

• Own end-to-end data extraction workflows across complex websites, ensuring comprehensive coverage, accuracy, and reliable delivery of structured datasets.
• Leverage internal tools (Apify, OpenRouter) and custom workflows to accelerate data collection, validation, and task execution, meeting all defined requirements.
• Ensure reliable extraction from dynamic and interactive web sources, adapting strategies to handle JavaScript-rendered content and evolving site behavior.
• Enforce rigorous data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification before delivery.
• Scale scraping operations for large datasets using efficient batching or parallelization, monitoring failures, and maintaining stability against minor site structure changes.

How To Get Started

Simply apply to this post, qualify, and gain the opportunity to contribute to projects that align with your technical skills, all on your own flexible schedule. From coding and automation to fine-tuning AI outputs, you will play a crucial role in advancing AI capabilities and real-world applications.

Requirements

• At least 1 year of relevant experience in data analysis, AI automation, data engineering, or software development is desirable.
• A Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
• Python web scraping: Ability to build reliable scraping scripts using BeautifulSoup, Selenium (or equivalents) for multi-level sites, dynamic JS content (infinite scroll, AJAX), and API endpoints via provided proxy.
• Data extraction expertise: Proficiency in navigating complex hierarchical structures (e.g., regions → companies → details), handling archived pages, and various HTML formats.
• Data processing: Skills to clean, normalize, and validate scraped data; deliver high-quality datasets in well-structured formats (CSV, JSON, Google Sheets) with clear, consistent presentation.
• Hands-on experience with Large Language Models (LLMs) and AI frameworks to enhance automation and problem-solving.
• Strong attention to detail and unwavering commitment to data accuracy.
• Self-directed work ethic with the proven ability to troubleshoot independently.
• English proficiency: Upper-intermediate (B2) or above (required).

Benefits

Discover why this freelance opportunity at Braintrust is an excellent fit:

• Get compensated for your expertise, with rates potentially reaching up to $30/hour, depending on your skills, experience, and specific project needs.
• Work fully remotely on your preferred schedule, requiring only a laptop and a stable internet connection.
• Gain invaluable hands-on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly, developing a distinctive and in-demand skill set.
• Participate in performance-based bonus programs that recognize and reward high-quality work and consistent delivery.

Key skills/competency

• Web Scraping
• Data Extraction
• Python
• Selenium
• BeautifulSoup
• Data Processing
• AI Automation
• Large Language Models (LLMs)
• Data Quality
• Structured Data