ConsumerAffairs Review Scraper

Scrape customer reviews and warranty service ratings from ConsumerAffairs.com. This actor handles pagination automatically and outputs structured data.

Overview

This actor extracts customer reviews from specified service pages on ConsumerAffairs.com. It collects reviewer details, ratings, and full text, managing multi-page results through built-in pagination. It's designed for reliable data collection with proxy support and configurable limits.

Key Features

• Extracts comprehensive review data: Includes reviewer name, location, date, star rating (1-5), and the full review text.
• Automatic pagination: Uses the response_url field in the output to find and scrape subsequent pages until the item limit is reached or no more pages exist.
• Built for reliability: Supports the Apify Proxy to avoid blocks and includes configurable rate limits.
• Structured output: Returns clean, consistent JSON data for each review.

Input Configuration

Configure the actor run using the following input parameters.

{
  "proxyConfiguration": {
    "useApifyProxy": true
  },
  "item_limit": 40,
  "urls": [
    "https://www.consumeraffairs.com/auto_warranty/endurance-warranty.html"
  ]
}

Output

The actor outputs a dataset where each item represents a single review. Below is a sample item and a description of its fields.

{
  "response_url": "https://domain/...page=2",
  "name": "Keith",
  "location": "Hutchinson, MN",
  "date": "Reviewed April 30, 2025",
  "review_text": "The purchase process was very straightforward...",
  "rating": "4"
}

How to Use

Using the Apify API (Python Example)

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_KEY")

run_input = {
    "item_limit": 50,
    "urls": ["https://www.consumeraffairs.com/finance/company.html"],
    "proxyConfiguration": {"useApifyProxy": True}
}

actor_call = client.actor("your-username/my-consumeraffairs-actor").call(run_input=run_input)

# Iterate through the results
for item in client.dataset(actor_call["defaultDatasetId"]).iterate_items():
    if item['response_url']:
        print(f"Next page: {item['response_url']}")
    print(f"Review from {item['name']} ({item['rating']}/5)")

Support & Customization

For custom modifications, higher limits, or other requests, contact the developer:
* Email: support@getdataforme.com
* Contact Form: https://getdataforme.com/contact/

Technical Notes: The actor includes automatic retries for failed requests, adheres to the site's robots.txt, and performs HTML-to-text sanitization on the extracted data.