Airbnb Free Scraper

A web crawler for extracting detailed Airbnb listing data from specific locations or search URLs. It handles pagination and parallel requests to efficiently gather property information.

Key Features

• Flexible Input: Scrape by location (e.g., "Paris--France") or by providing specific Airbnb search URLs with filters already applied.
• Pagination: Automatically navigates through multiple pages of search results.
• Parallel Processing: Configurable concurrency for faster data collection.
• Comprehensive Data: Extracts a wide range of listing details, from host info and amenities to reviews and location data.
• Robust Operation: Includes error handling, retry logic, and built-in delays to manage rate limiting.

How to Use

Configure the actor using input parameters. You can use locations, URLs, or a combination of both.

Input Parameters

Required:
* locations: An array of location strings.
* Format: "City--Country" or "City--State--Country"
* Example: ["London--UK", "New-York--NY--United-States"]
* Default: ["Paris--France"]

Optional:
* urls: Array of specific Airbnb search URLs (preserves filters).
* pages: Number of result pages to scrape per location/URL. Default: 2, Max: 20.
* concurrency: Number of parallel API requests. Default: 3, Max: 6.
* delay: Delay between requests in milliseconds. Default: 300.
* maxRetries: Maximum retry attempts for failed requests. Default: 3.

Input/Output

Usage Examples

Basic Location Scraping:

{
  "locations": ["Paris--France"],
  "pages": 3
}

Scraping from a Filtered URL:

{
  "urls": ["https://www.airbnb.com/s/Tokyo/homes?price_min=50&price_max=200"],
  "pages": 5
}

Multiple Inputs with Higher Concurrency:

{
  "locations": ["Barcelona--Spain", "Rome--Italy"],
  "urls": ["https://www.airbnb.com/s/London/homes?guests=4"],
  "pages": 2,
  "concurrency": 5
}

Output Data

The actor outputs a stream of JSON objects, one per listing. Each listing includes:

• Basic Info: id, title, url, personCapacity.
• Host Details: Name, profile, superhost status, response rate.
• Property Details: Type, description, full list of amenities, photos with metadata.
• Reviews & Ratings: Count, average, and detailed category ratings.
• Location & Policies: Coordinates, houseRules, cancellationPolicy.
• Metadata: scrapedAt timestamp.

A final summary includes the input parameters used, total processing time, and success/error counts.

Performance & Limitations

• The built-in delay and configurable concurrency help prevent overwhelming target servers.
• It respects Airbnb's robots.txt and rate limits.
• Pagination stops automatically when no more results are found.
• The actor handles network errors with retries and manages incomplete data gracefully.
• Output is streamed to be memory-efficient.