Substack Notes Scraper 🔍 Extract valuable content and engagement data from Substack Notes search results. This actor helps you gather insights about discussions, trends, and user engagement around specific topics on Substack's social platform. ## 🎯 Use Cases - Monitor discussions around specific keywords or topics - Track user engagement and content performance - Analyze visual content trends through attached images - Research user behavior and community interactions - Gather social proof and testimonials - Track competitor activities and engagement ## ✨ Features - 🔎 Search-based data extraction - 👤 Detailed user information (name, handle, bio) - 📊 Engagement metrics (reactions, restacks, comments) - 🖼️ Image attachments with dimensions - ⏱️ Timestamp data for temporal analysis - 🔄 Automatic pagination handling - 🚀 Stealth mode to avoid detection ## 🔢 Output The actor provides detailed JSON output including: - User profile information - Note content and metadata - Engagement metrics - Image attachments - Timestamps - Search context ## 💡 Input Parameters - keywords (Array): List of keywords to search for - maxItems (Number): Maximum number of items to scrape - proxyConfiguration (Object): Proxy settings (optional) ## 📌 Limitations - Respects Substack's rate limits and terms of service - Search results are limited to public notes - Image downloads require additional processing ## 💪 Tips for Best Results 1. Use specific keywords for targeted results 2. Adjust maxItems based on your needs 3. Consider using proxies for large-scale scraping 4. Allow sufficient run time for complete data collection ### Input Example A full explanation of an input example in JSON. json { "keywords": [ "sale" ], "maxItems": 50 } ### Output sample The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. json [ { "keyword": "sale", "entityKey": "c-91995525", "type": "comment", "user": { "id": 310653644, "name": "Chris Sale", "handle": "chrissalephoto", "photoUrl": "https://substack-post-media.s3.amazonaws.com/public/images/b5673547-b3db-4089-9e43-f32170dba61b_96x96.jpeg", "bio": "Landscape photographer based in Cumbria. Sharing stories from the Eden Valley and the North Pennines. " }, "comment": { "id": 91995525, "body": "Bothy | Melmerby Fell, North Pennines AONB | February 2025", "date": "2025-02-08T14:19:40.888Z", "reactionCount": 60, "reactions": { "❤": 60 }, "restacks": 1, "childrenCount": 5 }, "attachments": [ { "id": "5a9aef05-696f-4bb5-a9bf-45807bcaf2da", "type": "image", "imageUrl": "https://substack-post-media.s3.amazonaws.com/public/images/8bc060ec-f0c6-43a4-b4b8-6ca80b54cec9_2160x2700.jpeg", "imageWidth": 2160, "imageHeight": 2700 } ], "scrapedAt": "2025-02-10T05:59:15.575Z" }, ... ] ## Related Actors - 📚 Substack People Scraper - Extract comprehensive Substack author and publication data using keywords - 📚 Substack Posts Scraper - Scrape Substack posts and articles with comprehensive post data - 📚 Substack Publications Scraper - Get detailed publication information from Substack based on keywords - 📊 Substack Leaderboard Scraper - Extract detailed publication data from Substack leaderboards - 📝 Article Content Extractor - Extract clean article content and metadata from any web page - 🔍 Text Sentiment Analysis - Analyze the sentiment of text content with detailed sentiment breakdown - 📧 Discover & Verify Professional Emails - Find and verify professional email addresses instantly - 🔍 Keyword Discovery Tool - Discover new keyword ideas and valuable search insights - 🔍 Reddit Posts Search Scraper - Extract Reddit posts with rich metadata from search results - 💬 Reddit Comments Search Scraper - Search and extract Reddit comments with advanced filtering options - 📱 Medium Posts Search Scraper - Extract comprehensive article data from Medium's search results - 📱 Medium User Posts Scraper - Extract detailed post data from Medium user profiles - 📱 Tumblr Posts Scraper - Scrape Tumblr blog posts with media content and engagement metrics - 🔍 Tumblr Tags Scraper - Extract comprehensive Tumblr tag data and trending posts - 🌟 Tumblr Community Search Scraper - Extract valuable insights from Tumblr communities