Recaptcha Bypass Browser Scraper PRO

Overview

This actor is a web scraping tool designed to handle sites protected by Google's reCaptcha and other sophisticated bot detection systems. It uses a headless browser to render JavaScript-heavy pages and includes mechanisms to automatically bypass these protections, making it suitable for scraping heavily guarded websites.

Key Features

• reCaptcha Bypass: Automatically solves Google's reCaptcha challenges.
• Anti-Bot Evasion: Navigates sites with advanced bot detection.
• JavaScript Execution: Fully supports dynamic, JavaScript-rendered content and allows you to run custom JavaScript on each page.
• Robust Infrastructure: Includes intelligent retry logic with exponential backoff and built-in support for proxy rotation.
• Scalability: Can process hundreds of URLs concurrently.
• Comprehensive Data Capture: Returns the fully rendered HTML of a page and the output of any custom scripts.

How to Use

1. Provide Input: Supply a list of target URLs in the actor's input configuration.
2. Configure Settings: Optionally set the number of retries, specify proxy settings (like useApifyProxy), and adjust timeouts.
3. Add Custom Logic: Insert your own JavaScript code if you need to extract specific data or interact with the page.
4. Run the Actor: Start the scraper. It will navigate to each URL, bypass protections, execute your scripts, and return the results.

Input/Output

Input Configuration:
The actor accepts a JSON input. A basic example to test its core functionality is:

{
  "urls": ["https://www.apify.com/?fpr=python_automation"],
  "max_retries_per_url": 2,
  "proxy": { "useApifyProxy": false },
  "js_script": "return document.title;",
  "js_timeout": 10,
  "retrieve_result_from_js_script": true,
  "page_is_loaded_before_running_script": true,
  "execute_js_async": false,
  "retrieve_html_from_url_after_loaded": true
}

Output Data:
The actor returns structured data for each successfully processed URL, which includes:
* scrapedUrl: The original URL.
* jsResult: The output from executing your custom js_script.
* html: The complete, rendered HTML of the page after all protections are bypassed.
* Metadata about the scraping process.

Testing:
To run a test with the example configuration, use the command:

apify run

Use Cases

Common applications include scraping competitor prices on protected e-commerce sites, collecting data from financial or real estate platforms, lead generation from business directories, and monitoring travel booking systems.

For detailed API references, integration guides, or enterprise support, refer to the documentation available via the Apify console.