Lead Extractor - Yellow Pages (Global)

An Apify Actor built on the PuppeteerCrawler template for scraping business lead data from Yellow Pages websites globally. It uses headless Chrome via Puppeteer to handle JavaScript-rendered pages, making it suitable for modern web scraping where simple HTTP requests are insufficient.

Key Features

• Puppeteer Crawler: Parallel crawling framework using headless Chrome to execute JavaScript on target pages.
• Proxy Support: Configurable proxy rotation (via Apify Proxy or custom proxies) to manage request rates and avoid IP blocking.
• Structured Output: Extracted data is stored in a structured Apify Dataset, with each item containing consistent fields.
• Input Schema: Uses a defined input schema for clear configuration and validation of run parameters.
• Custom Routing: Request handling is managed through a customizable router (routes.js), allowing for different logic per URL pattern.

How to Use

The Actor follows a standard Crawlee/Puppeteer flow:

1. Input: The run starts by reading configuration from the provided INPUT.json.
2. Crawler Setup: A PuppeteerCrawler instance is created, configured with a proxy setup and a custom request handler.
3. Request Handling: The router in routes.js processes each page. You define handlers (e.g., for search listings and detail pages) to extract the specific business data you need (like company name, phone, address).
4. Data Storage: Extracted lead information is pushed to the Actor's Dataset using Dataset.pushData().
5. Execution: The crawler runs through the provided start URLs and completes when all defined requests are processed.

Input / Output

Input (INPUT.json):
Configure the Actor's run via the input schema. Essential parameters typically include:
* startUrls: The Yellow Pages search URLs or specific business page URLs to begin scraping.
* proxyConfiguration: Settings for proxy usage.
* Custom fields for pagination, search terms, or output filtering specific to lead generation.

Output:
Results are stored in the Apify Dataset. Each item is a structured object containing the scraped lead fields. Example output structure:

{
  "companyName": "Example Business Inc.",
  "phone": "+1-234-567-8900",
  "address": "123 Main St, City, Country",
  "website": "https://example.com",
  "sourceUrl": "https://www.yellowpages.com/listings/example-business"
}

Resources

• Crawlee + Apify Platform guide
• PuppeteerCrawler Documentation and Examples
• Apify SDK Documentation
• Input Schema Guide