Free Google Search Results (SERP) Scraper - Only $0.25 per 1,000 results Ultra-fast Google Search scraper with 1000 free results/month. Extract comprehensive SERP data including rank, title, snippet, URL, domain, favicon, and deeplinks. 50 concurrent requests for maximum performance. ## Features - Bulk Keyword Scraping: Process up to 100 keywords in a single run - Ultra-Fast Performance: 50 concurrent HTTP requests for maximum speed - High-Volume Scraping: Can fetch 1000+ results in seconds - Concurrent Processing: HTTP requests and HTML parsing in parallel - Comprehensive Data: Rank, domain, URL, title, snippet, favicon, deeplinks, keyword - Global Coverage: Support for 176 countries with automatic domain mapping - Scalable Pricing: Free tier (1000/month) + Pay-per-use ($0.25/1000) ## Input | Field | Type | Required | Description | Default | |-------|------|----------|-------------|---------| | queries | Array | Yes | Array of search queries (1-100 keywords) | - | | country | String | No | Country code (us, nl, de, uk, jp, au, etc.) | us | | cr | String | No | Country restrict parameter (e.g., countryDE) | - | | maxResults | Integer | No | Maximum results per query | 10 | ### Input Examples #### Multiple Keywords (Bulk Scraping) json { "queries": [ "artificial intelligence", "machine learning", "deep learning" ], "country": "us", "maxResults": 10 } #### Single Keyword json { "queries": ["koffie"], "country": "de", "maxResults": 10 } #### With Country Restrict json { "queries": ["machine learning"], "country": "nl", "cr": "countryDE", "maxResults": 20 } ## Output Each result contains: | Field | Type | Description | |-------|------|-------------| | rank | Integer | SERP position (1, 2, 3, ...) | | domain | String | Display domain name | | url | String | Full result URL | | title | String | Page title | | snippet | String | Meta description/snippet | | favicon | String | Favicon URL or base64 data URI | | deeplink | String | Breadcrumb path (e.g., "domain.com › page › subpage") | | keyword | String | The search query that returned this result | ### Output Example json [ { "rank": 1, "domain": "Pons", "url": "https://de.pons.com/%C3%BCbersetzung/niederl%C3%A4ndisch-deutsch/koffie", "title": "KOFFIE - Niederländisch-Deutsch Übersetzung", "snippet": "Übersetzung Niederländisch-Deutsch für KOFFIE im PONS Online-Wörterbuch nachschlagen! Gratis Vokabeltrainer, Verbtabellen, Aussprachefunktion.", "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...", "deeplink": "https://de.pons.com › übersetzung", "keyword": "koffie" }, { "rank": 2, "domain": "Kaffee Henk", "url": "https://www.kaffeehenk.de/?srsltid=AfmBOorVJOb3RWHj67_FdYafeEGVWn1igSwK7KAWW8NlsLygRP6elS4g", "title": "Größtes und günstigstes Kaffeesortiment in Europa!", "snippet": "Hier finden Sie die besten kaffee wie Melitta, Jacobs, Tchibo, Dallmayr, Segafredo, Lavazza, Eduscho und Mövenpick.", "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...", "deeplink": "https://www.kaffeehenk.de", "keyword": "koffie" }, { "rank": 3, "domain": "Langenscheidt", "url": "https://de.langenscheidt.com/niederlaendisch-deutsch/koffie", "title": "Niederländisch-Deutsch Übersetzung für \"koffie\"", "snippet": "Übersetzung für 'koffie' im kostenlosen Niederländisch-Deutsch Wörterbuch von LANGENSCHEIDT – mit Beispielen, Synonymen und Aussprache.", "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...", "deeplink": "https://de.langenscheidt.com › niederlaendisch-deutsch", "keyword": "koffie" } ] ## Supported Countries The scraper supports 176 countries with automatic Google domain mapping: ### Africa (46 countries) Algeria (dz), Angola (ao), Benin (bj), Botswana (bw), Burkina Faso (bf), Burundi (bi), Cameroon (cm), Cape Verde (cv), Central African Republic (cf), Chad (td), Congo DRC (cd), Congo (cg), Côte d'Ivoire (ci), Djibouti (dj), Egypt (eg), Ethiopia (et), Gabon (ga), Gambia (gm), Ghana (gh), Guinea-Bissau (gw), Kenya (ke), Lesotho (ls), Libya (ly), Madagascar (mg), Malawi (mw), Mali (ml), Mauritius (mu), Morocco (ma), Mozambique (mz), Namibia (na), Niger (ne), Nigeria (ng), Rwanda (rw), São Tomé and Príncipe (st), Senegal (sn), Seychelles (sc), Sierra Leone (sl), Somalia (so), South Africa (za), Tanzania (tz), Togo (tg), Tunisia (tn), Uganda (ug), Zambia (zm), Zimbabwe (zw) ### Americas (26 countries) Argentina (ar), Bahamas (bs), Bolivia (bo), Brazil (br), Canada (ca), Chile (cl), Colombia (co), Costa Rica (cr), Cuba (cu), Dominica (dm), Dominican Republic (do), Ecuador (ec), El Salvador (sv), Guatemala (gt), Guyana (gy), Haiti (ht), Honduras (hn), Jamaica (jm), Mexico (mx), Nicaragua (ni), Panama (pa), Paraguay (py), Peru (pe), Trinidad and Tobago (tt), United States (us), Uruguay (uy), Venezuela (ve) ### Asia (46 countries) Afghanistan (af), Armenia (am), Azerbaijan (az), Bahrain (bh), Bangladesh (bd), Bhutan (bt), Brunei (bn), Cambodia (kh), China (cn), Georgia (ge), Hong Kong (hk), India (in), Indonesia (id), Iraq (iq), Israel (il), Japan (jp), Jordan (jo), Kazakhstan (kz), South Korea (kr), Kuwait (kw), Kyrgyzstan (kg), Laos (la), Lebanon (lb), Malaysia (my), Maldives (mv), Mongolia (mn), Myanmar (mm), Nepal (np), Oman (om), Pakistan (pk), Palestine (ps), Philippines (ph), Qatar (qa), Saudi Arabia (sa), Singapore (sg), Sri Lanka (lk), Taiwan (tw), Tajikistan (tj), Thailand (th), Timor-Leste (tl), Turkey (tr), Turkmenistan (tm), United Arab Emirates (ae), Uzbekistan (uz), Vietnam (vn), Yemen (ye) ### Europe (49 countries) Albania (al), Andorra (ad), Austria (at), Belarus (by), Belgium (be), Bosnia and Herzegovina (ba), Bulgaria (bg), Croatia (hr), Cyprus (cy), Czech Republic (cz), Denmark (dk), Estonia (ee), Finland (fi), France (fr), Germany (de), Gibraltar (gi), Greece (gr), Guernsey (gg), Hungary (hu), Iceland (is), Ireland (ie), Isle of Man (im), Italy (it), Jersey (je), Kosovo (xk), Latvia (lv), Liechtenstein (li), Lithuania (lt), Luxembourg (lu), North Macedonia (mk), Malta (mt), Moldova (md), Montenegro (me), Netherlands (nl), Norway (no), Poland (pl), Portugal (pt), Romania (ro), Russia (ru), San Marino (sm), Serbia (rs), Slovakia (sk), Slovenia (si), Spain (es), Sweden (se), Switzerland (ch), Ukraine (ua), United Kingdom (uk), Vatican City (va) ### Oceania (9 countries) Australia (au), Fiji (fj), Kiribati (ki), Nauru (nr), New Zealand (nz), Papua New Guinea (pg), Samoa (ws), Tonga (to), Vanuatu (vu) Note: Special domains are automatically handled (e.g., Indonesia uses google.co.id, UK uses google.co.uk, USA uses google.com). ## Pricing ### Free Tier - 1,000 results per month - Free forever - Perfect for small-scale projects and testing - No credit card required - Automatic monthly reset ### Pay-Per-Use Tier - $0.25 per 1,000 results - Cheapest in the market - No monthly limits - Only pay for what you use - Ideal for high-volume scraping - Example costs: - 1,000 results = $0.25 - 10,000 results = $2.50 - 100,000 results = $25.00 When free tier limit is reached, the actor will prompt you to upgrade to pay-per-use pricing. ## How It Works The scraper uses high-performance concurrent scraping: 1. Session Initialization: Establishes cookies with Google 2. Parallel Fetching: Makes up to 50 concurrent requests to WRGA endpoint 3. Concurrent Parsing: Parses all HTML responses in parallel using thread pool 4. Negative Search: If more results needed, performs additional concurrent fetches excluding top domains 5. Deduplication: Ensures unique results and assigns continuous ranking Concurrency Control: - Semaphore limits: 50 concurrent requests - Connection pooling: 50 keepalive, 100 max connections - All operations are non-blocking with asyncio ## Performance - Small batches: ~1 second for 10 results - Medium batches: ~3-5 seconds for 100 results - Large batches: ~10-15 seconds for 1000 results - Concurrency: 50 parallel HTTP requests + concurrent parsing - Connection pooling: 50 keepalive connections for efficiency - Retry logic: Exponential backoff with 3 attempts per request ## Technical Details - Parser: lxml with XPath selectors - HTTP Client: httpx with async support - Timeouts: 5s connect, 60s read - Retry Logic: Exponential backoff (max 3 attempts) - Session Management: Cookie-based session initialization ## Use Cases - SEO monitoring and competitor analysis - SERP position tracking - Market research and trend analysis - Content gap analysis - Brand mention monitoring - Academic research ## Limitations - Google may rate-limit heavy usage - Some results may have generic favicons - Deeplinks may fall back to full URLs for certain sites - Requires active internet connection ## License MIT License - free to use for commercial and non-commercial projects. ## Privacy This actor does not store any personal data. All scraped data is publicly available on Google Search.