WG-Gesucht Property Search Scraper

Overview

This actor is a specialized scraper for extracting rental property listings from WG-Gesucht.de, one of Germany's largest rental platforms. It automates data collection from search result pages, handling the site's structure and anti-bot measures to provide structured output for analysis.

Key Features

• Extracts property listings from WG-Gesucht.de search URLs.
• Handles various property types: flatshares, 1-room apartments, full apartments, and coliving spaces.
• Manages proxy rotation (via Apify Proxy) and respectful crawling to avoid blocks.
• Outputs clean, structured data (JSON) ready for integration or analysis.
• Configurable for retries, request delays, and maximum items to scrape.

How to Use

Provide a JSON input configuration to the actor. At minimum, you must include the startUrls array containing one or more WG-Gesucht.de search URLs. Configure other parameters like proxy settings, pagination limits, and request handling as needed.

Run the actor on the Apify platform. It will navigate the provided URLs, scrape all listed properties according to your limits, and deliver the dataset.

Input/Output

Input

The actor accepts a JSON configuration. Here are the essential parameters:

{
  "startUrls": [
    "https://www.wg-gesucht.de/1-zimmer-wohnungen-in-Berlin.1.1.3.0.html"
  ],
  "maxItemsPerStartUrl": 100,
  "maxRequestRetries": 2,
  "requestDelay": 1000,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "DE"
  }
}

• startUrls: (Required) Array of WG-Gesucht.de search URLs to scrape.
• maxItemsPerStartUrl: Limit the number of listings scraped per URL.
• maxRequestRetries: Number of retries for failed requests.
• requestDelay: Delay (in ms) between requests to be respectful.
• proxy: Configuration for Apify Proxy; using residential proxies is recommended.

Output

The actor outputs a dataset where each item represents a scraped property listing. Each item is a JSON object containing fields like:
* title: The listing title.
* price: Monthly rent.
* size: Property size in square meters.
* address: General location/area.
* available_from: Move-in date.
* description: Full listing text.
* url: Link to the original listing page.
* Various details about rooms, features, and landlord information.

The data is provided in a structured format suitable for export as JSON, CSV, or via Apify's API.

Contact

For issues or questions, contact the developer via My profile.