🔍 Google News Scraper Transform your news monitoring with our Google News scraper! Whether you're tracking market trends, monitoring brand mentions, or conducting research, this tool efficiently collects and structures news data from Google News. Built for performance and reliability, it handles multilingual content and various regional editions with ease. ## 💎 Why Choose Our Google News Scraper? - 🔓 Smart URL Decoder: Access original article sources with our powerful decoding system - 🚀 Lightning-Fast Description Extraction: Extract article descriptions with our exclusive anti-blocking solution - 🔍 Multi-Keyword Power: Search multiple topics simultaneously to maximize your data gathering - ⏱️ Flexible Time Frames: Choose from various time periods to get exactly the data you need - 🌎 Global Coverage: Support for 70+ regions and languages to access worldwide news - ⚡ Blazing Speed: Optimized performance with parallel processing for ultra-fast results - 🖼️ Image Quality: Automatically extract high-resolution images from articles ## 🔮 How to Power Up Your Search Keywords? You can enhance your search queries using Google News search operators: - Use - to exclude words (e.g., bitcoin -ethereum will show bitcoin news but exclude those mentioning ethereum) - Use site: to filter by specific website (e.g., bitcoin site:cnn.com will only show articles from CNN) - Use OR to search for multiple terms (e.g., bitcoin OR ethereum will show articles containing either term) ## ✨ What You'll Get ### 📰 News Data Structure | Field | Description | |-------|-------------| | title | Title of the news article | | source | Source/publisher of the news | | url | Direct link to the article | | description | Article description extracted from the original source (if enabled) | | publishedAt | ISO date of publication (when available) | | publishedTimestamp | Unix timestamp (ms) of publication (when available) | | image | Article image URL (upgraded to higher resolution when available) | | metadata | Additional information about the scraping (scrapeTimestamp, keyword, timeframe) | ## 🚀 Performance Features ### ⚡️ Lightning Fast: - Proxy support via Apify Proxy (configured in the UI) - Optimized resource usage - Smart retry mechanism ### 🛠️ Smart Handling: - Automatic URL standardization - Support for all Google News domains - Intelligent error handling - Multi-keyword processing ### 🌍 Global Coverage: - Works with any country/language combination - Captures news in all languages - Standardizes output format ## 📋 Quick Start ### Input Parameters | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | keywords | array | ["bitcoin"] | List of keywords to search | | maxArticles | number | 20 | Number of news to collect per keyword (0 = no limit) | | timeframe | string | "1h" | Time period for news (1h/1d/7d/1y/all) | | region_language | string | "US:en" | Region and language combination | | decodeUrls | boolean | false | Decode Google News URLs to get original article URLs | | extractDescriptions | boolean | false | Extract article descriptions from original sources | | proxyConfiguration | object | {"useApifyProxy": true} | Configure Apify Proxy in the UI (works with Limited permissions) | ### Input Example json { "keywords": ["bitcoin"], "maxArticles": 20, "timeframe": "1h", "region_language": "US:en", "decodeUrls": false, "extractDescriptions": true, "proxyConfiguration": { "useApifyProxy": true } } ### Output Example json [ { "title": "Bitcoin Hits New All-Time High", "source": "Financial Times", "url": "https://ft.com/article/...", "publishedAt": "2025-02-22T12:41:25.936Z", "publishedTimestamp": 1740283285936, "image": "https://news.google.com/api/attachments/...-w800-...-h400-...", "description": "Bitcoin jumps 20% after new signals from regulators...", "metadata": { "scrapeTimestamp": "2025-02-22T12:41:25.936Z", "keyword": "bitcoin", "timeframe": "1h" } } ] ## 🤝 Support & Resources Need help? Have questions? We're here to help! If you encounter any issues or have feature requests, please don't hesitate to open an issue. ❤️ Love our scraper? Please leave a review here