Cointelegraph Search Scraper 🔍 Powerful scraper for extracting article data from Cointelegraph's search results. Get detailed information about crypto news articles matching your keywords. ## Features ✨ - 🎯 Search for multiple keywords - 📊 Extract comprehensive article metadata - ⏱️ Automatic scrolling with smart detection - 🚀 High-performance and reliable - 🛡️ Built-in anti-blocking measures ## Output Data Structure 📋 For each article, you'll get: - Article title and slug - Author information - Publication date and time - View count - Category and badges - Lead text/description - Article URL - Scraping timestamp ## Usage 💡 1. Enter your search keywords 2. Set maximum items to scrape (optional) 3. Run the actor and get structured JSON results ## Input Parameters 📝 - keywords: Array of keywords to search for - maxItems: Maximum number of items to scrape (default: unlimited) ## Use Cases 🎯 - Crypto news monitoring - Market research and analysis - Content aggregation - Competitive analysis - Trading signals generation ## Limitations ⚠️ - Respects Cointelegraph's robots.txt - Rate limiting implemented for stability - Maximum 1000 results per search term recommended Need custom features or modifications? Contact us for support! 🤝 ### Input Example A full explanation of an input example in JSON. json { "keywords": [ "fashion" ], "maxItems": 20 } ### Output sample The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. json [ { "keyword": "trump", "post": { "id": "171373", "slug": "ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader", "views": 497, "postTranslate": { "id": "1027264", "title": "Ramaswamy exits DOGE for Ohio governor bid, leaving Musk as sole head", "leadText": "Vivek Ramaswamy said on X he was leaving the Department of Government Efficiency and was “confident that Elon and the team will succeed in streamlining government.”", "avatar": "https://s3.cointelegraph.com/uploads/2025-01/0194866e-1a22-73f9-b4d2-4e0f69274bb2", "published": "2025-01-21T03:50:25+00:00", "publishedHumanFormat": "40 minutes ago", "author": { "id": "1056", "slug": "martin-young", "authorTranslates": [ { "id": "17082", "name": "Martin Young", "__typename": "AuthorTranslate" } ], "__typename": "Author" }, "__typename": "PostTranslate" }, "category": { "id": "2", "slug": "latest-news", "categoryTranslates": [ { "id": "67", "title": "Latest News", "__typename": "CategoryTranslate" } ], "__typename": "Category" }, "author": { "id": "1056", "slug": "martin-young", "authorTranslates": [ { "id": "17082", "name": "Martin Young", "__typename": "AuthorTranslate" } ], "__typename": "Author" }, "postBadge": { "id": "38", "label": "default", "postBadgeTranslates": [ { "id": "815", "title": "News", "__typename": "PostBadgeTranslate" } ], "__typename": "PostBadge" }, "showShares": true, "showStats": true, "__typename": "Post", "postUrl": "https://cointelegraph.com/news/ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader" }, "scrapedAt": "2025-01-21T04:31:10.324Z" }, ... ]