Google Search Scraper An Apify actor for scraping Google search results with customizable parameters. The actor extracts URLs, titles, and descriptions from Google search results pages. ## Features - Scrape Google search results based on your search terms - Customize the number of results to retrieve - Set language and region preferences - Enable or disable Google's SafeSearch - Filter out duplicate URLs - Automatic proxy rotation using Apify Proxy (if available) - Random user agent generation to avoid blocking - Real-time processing: Results are pushed to the dataset as they are found, without waiting for all results to be collected ## Input Parameters The actor accepts the following input parameters: | Parameter | Type | Description | |-----------|------|-------------| | searchTerm | String | Required. The search query to look for on Google. | | numResults | Integer | Number of search results to retrieve. Default is 10. | | lang | String | Language code for the search results (e.g., 'en', 'es', 'fr'). Default is 'en'. | | safe | String | SafeSearch setting: 'active' or 'off'. Default is 'active'. | | region | String | Region code for the search results (e.g., 'us', 'uk', 'de'). | | start | Integer | Starting index for the search results. Default is 0. | | unique | Boolean | Whether to filter out duplicate URLs. Default is true. | ## Output The actor stores its results in the default dataset, with each item having the following structure: json { "url": "https://example.com", "title": "Example Title of the Search Result", "description": "A snippet or description of the search result as shown by Google..." } ## Usage Examples ### Basic Example json { "searchTerm": "apify web scraping" } ### Advanced Example json { "searchTerm": "machine learning tutorials", "numResults": 50, "lang": "en", "safe": "active", "region": "us", "start": 0, "unique": true } ## Proxy Usage The actor automatically uses Apify Proxy if available in your subscription plan. This helps avoid IP-based blocking and provides more reliable results. If Apify Proxy is not available, the actor will run without a proxy. ## Limitations - Google may detect and block automated scraping attempts. The actor implements measures to minimize this risk, but successful operation cannot be guaranteed in all cases. - The structure of Google's search results page may change over time, which could affect the actor's ability to extract data correctly. - For heavy usage, consider implementing delays between requests or use a pool of proxies.