Google Search Scraper Actor

Overview

This Apify Actor scrapes Google search results based on your query and parameters. It returns structured data including titles, links, snippets, and other relevant information. You can customize the search type, filters, and pagination.

Key Features

• Multiple search types: Scrape web, images, news, and other Google search results.
• Flexible filtering: Filter results by language, region, date, site, file type, and specific word conditions.
• Pagination control: Specify the number of pages, results per page, and starting page.
• Deduplication: Option to return only unique URLs or domains.
• Advanced search: Use exact phrases, required/allowed/excluded words, and number ranges.
• Proxy support: Built-in proxy configuration, defaulting to Apify Proxy with residential IPs.

How to Use

Configure the Actor via input parameters, then run it. The scraper will navigate Google search pages and extract structured data based on your settings.

Input Parameters

The main required parameter is query. Other common parameters include:

Filtering options:
- site: Restrict to specific domain
- file_type: Filter by file type (e.g., pdf)
- all_words / exact_phrase / any_words / none_words: Control word matching
- numbers_from / numbers_to: Filter by number ranges

Example input:

{
  "query": "python scraping",
  "search_type": "web",
  "pages": 3,
  "language": "english",
  "safe_search": true,
  "proxy_configuration": {
    "useApifyProxy": true
  }
}

Output Format

The Actor outputs an array of objects with this structure:

{
  "host": "example.com",
  "link": "https://example.com/page",
  "image": "https://example.com/image.jpg", // or null
  "title": "Page Title",
  "text": "Result snippet text",
  "engine": "Google",
  "page": 1
}

Each result includes the source hostname, full URL, title, descriptive snippet, and the page number where it was found. Image searches include the image URL field.

Notes

• Use the proxy_configuration for reliable scraping, especially at scale.
• Adjust the delay parameter to control request rate and avoid blocks.
• For advanced use cases, custom_url and custom_tbs allow direct Google parameter injection.
• The Actor handles pagination automatically based on pages and start_page settings.