📋 Substack Scraper ## ❗ Version 1 Notes - Currently, only the last 20 Posts are return, need more? Create a new issue - There are more data points available, we've started with the most popular, want something in particular? Create a new issue ## 🚀 What It Does Enter a Substack and retrieve all published content. This scraper extracts the complete content data from the Substack page, including posts and author details ## 💡 Why Use It? This scraper is perfect for: - Content analysis of Substack publications - Archiving Substack content - Monitoring specific publications - Data collection for research purposes ## 🔍 Substack Username Guidelines The scraper accepts Substack names in their basic form. Here are some examples: - Correct: marketingideas - Correct: mattlevine - Correct: noahpinion Note: Do not include '@' or '.substack.com' in the username. ## 🛠️ How to Use 1. Run the scraper through Apify platform 2. Enter the Substack name in the input field 3. The scraper will automatically: - Visit the Substack page - Extract all available content - Save the data to Apify Dataset - Stop when complete ## 📝 Sample Output The scraper saves data in a structured format including: json { "substack": "nickcohen", "author": { "author_url": "https://substack.com/@nickcohen", "author_id": 5183845, "author_name": "Nick Cohen", "author_handle": "nickcohen", "author_photo_url": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1db7a9b-2f54-4a2e-9799-917685c71adb_960x640.jpeg", "author_bio": "Journalist and commentator from the UK", "twitter_screen_name": "NickCohen4" }, "posts": [ { "id": 165338922, "title": "How aristocratic snobbery wrecked the UK", "description": "Michael Gove, Sarah Vine and the fury of the left-behind middle class", "slug": "how-aristocratic-snobbery-wrecked", "post_date": "2025-06-07T07:59:10.680Z", "url": "https://nickcohen.substack.com/p/how-aristocratic-snobbery-wrecked", "word_count": 1397, "audience": "only_paid", "reactions": { "❤": 75 }, "comment_count": 26, "truncated_body_text": "Image by Mike Finn. Flickr creative commons", "cover_image": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F175d86d3-ebc0-4be8-a78d-c676c9f5abc3_750x536.webp", "subtitle": "Michael Gove, Sarah Vine and the fury of the left-behind middle class" }, { "id": 165307596, "title": "Don’t ally with Elon Musk ", "description": "Your enemy’s enemy is NOT your friend", "slug": "dont-ally-with-elon-musk", "post_date": "2025-06-05T23:17:58.140Z", "url": "https://nickcohen.substack.com/p/dont-ally-with-elon-musk", "word_count": 812, "audience": "everyone", "reactions": { "❤": 89 }, "comment_count": 18, "truncated_body_text": "I try to keep posts about our crisis free to read so that they can receive a wide audience. But, if you can afford to, please consider supporting my journalism by becoming a paid subscriber.", "cover_image": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F809b427b-a403-45e3-9d0d-9e7f4c3fd547_503x432.png", "subtitle": "Your enemy’s enemy is NOT your friend" } ] }