Reddit Comments Scraper 💬 Extract complete comment threads from Reddit posts with full conversation context and rich metadata. ## 🌟 Features - Extract complete comment threads with nested replies - Capture user information and avatars - Track comment engagement metrics - Support for various content types (text, images) - Duplicate comment detection ## 📊 Output Data Structure Each comment includes: - Comment ID and metadata - Author information and avatar - Parent-child relationship tracking - Creation timestamp (ISO format) - Content and content type - Engagement metrics (upvotes) - Moderation status - Nested replies array ## 💡 Use Cases - Sentiment analysis - Discussion tracking - User engagement analysis - Content moderation monitoring - Community feedback analysis - Market research - Academic research - Social media monitoring ## 🔧 Input Parameters | Parameter | Type | Description | |-----------|------|-------------| | postUrl | String | URL of the Reddit post to scrape | | maxItems | Integer | Maximum number of comments to scrape | | proxyConfiguration | Object | Optional proxy settings | ### Input Example A full explanation of an input example in JSON. { "postUrl": "https://www.reddit.com/r/ChatGPT/comments/1epeshq/these_are_all_ai/", "maxItems": 100 } ### Output sample The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. [ { "comment_id": "t1_lhk1f7n", "post_id": "t3_1epeshq", "author": "AutoModerator", "permalink": "https://www.reddit.com/r/ChatGPT/comments/1epeshq/comment/lhk1f7n/", "upvotes": 1, "content_type": "text", "parent_id": null, "author_avatar": "https://styles.redditmedia.com/t5_1yz875/styles/profileIcon_klqlly9fc4l41.png?width=64&height=64&frame=1&auto=webp&crop=64:64,smart&s=d2d22c53cc8b2756dc0cfabd790128c50c94a74d", "userUrl": "https://www.reddit.com/user/AutoModerator", "contentText": "Moderator Announcement\n Read More »\n \n \n \n \n Hey u/Maxie445!\n \n If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.\n \n If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.\n \n Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!\n \n 🤖\n \n Note: For any ChatGPT-related concerns, email support@openai.com\n \n I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.", "created_time": "2024-08-11T07:12:09.272000+0000" }, { "comment_id": "t1_lhkeis2", "post_id": "t3_1epeshq", "author": "Alternative_Lynx_155", "permalink": "https://www.reddit.com/r/ChatGPT/comments/1epeshq/comment/lhkeis2/", "upvotes": 1434, "content_type": "text", "parent_id": null, "author_avatar": "https://styles.redditmedia.com/t5_4g5czk/styles/profileIcon_729ggyg69ivd1.jpeg?width=64&height=64&frame=1&auto=webp&crop=64:64,smart&s=3efec1c537ca85a1aeacaa9a0c7a58b052181ef3", "userUrl": "https://www.reddit.com/user/Alternative_Lynx_155", "contentText": "That is crazy. When I was younger I thought thispersondoesnotexist.com was scary, but this is something completly different.", "created_time": "2024-08-11T09:39:54.843000+0000", "replies": [ { "comment_id": "t1_lhmhxjf", "post_id": "t3_1epeshq", "author": "who_am_i_to_say_so", "permalink": "https://www.reddit.com/r/ChatGPT/comments/1epeshq/comment/lhmhxjf/", "upvotes": 279, "content_type": "text", "parent_id": "t1_lhkeis2", "author_avatar": "https://styles.redditmedia.com/t5_9nppax/styles/profileIcon_kmdpkdhclabd1.png?width=64&height=64&frame=1&auto=webp&crop=64:64,smart&s=a0b6857e2d06bc9b7e7df01e5cea98fc4eacb31e", "userUrl": "https://www.reddit.com/user/who_am_i_to_say_so", "contentText": "I just spent 30 mins f5'ing that page. It's so addicting!", "created_time": "2024-08-11T18:22:16.497000+0000" } ] }, ... ]