Redfin Property Scraper

A reliable, multi-method scraper for extracting real estate data from Redfin.com. It uses several techniques (JSON API, HTML parsing, sitemap scraping, and Playwright) with automatic fallback to ensure data collection. Designed for production use with stealth and efficiency in mind.

Key Features

• Multi-Method & Fallback: Prioritizes the fast JSON API, then falls back to HTML parsing, sitemap scraping, or a stealth browser (Playwright) if needed.
• Stealth & Reliability: Uses rotating user agents, realistic headers, and handles rate limits. Supports residential proxies (via Apify Proxy) to avoid blocks.
• Efficient: Minimizes bandwidth and cost by using the lightweight JSON API first and only scraping full property details when configured.
• Comprehensive Data: Extracts property addresses, prices, beds/baths, square footage, MLS numbers, coordinates, property age, HOA fees, descriptions, and more.

How to Use

Configure the actor via input. At minimum, provide a startUrl. For production, use residential proxies.

Basic Configuration:

{
  "startUrl": "https://www.redfin.com/city/29470/IL/Chicago",
  "results_wanted": 50,
  "collectDetails": true
}

Production Configuration (Recommended):

{
  "startUrl": "https://www.redfin.com/city/29470/IL/Chicago",
  "results_wanted": 200,
  "max_pages": 5,
  "collectDetails": true,
  "maxConcurrency": 3,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Quick Region IDs:
| City | Region ID |
|------|-----------|
| Chicago, IL | 29470 |
| Los Angeles, CA | 30749 |
| New York, NY | 30753 |
| Houston, TX | 30794 |
| Phoenix, AZ | 9258 |

Input Parameters

Advanced Controls:
* Provide start URLs via startUrls (array), startUrl, or cityUrl.
* preferJson: Set to false to skip the JSON API first if your proxies are blocked.
* useHtmlFallback: Enables lightweight HTTP+Cheerio fallback.
* usePlaywright: Enables the slower but resilient stealth browser fallback. Use only if other methods are blocked.

Output

The actor outputs a dataset of property objects. Each object contains core listing data and, if collectDetails is true, a comprehensive set of details including full description, tax information, and interior features.