SubReddit Media Search Scraper 🎯 Advanced Reddit scraper that extracts media content (images and videos) from subreddit search results with rich metadata. ## 🌟 Features - Search and extract media posts from any subreddit - Support for multiple media types (images, videos, galleries) - Advanced sorting options (relevance, top, new, comments, hot) - Time-based filtering (hour, day, week, month, year, all) - Safe search toggle - Configurable maximum items limit ## 📊 Output Data Structure Each scraped post includes: - Post ID and basic metadata - Subreddit information - Author details - Creation timestamp (ISO format) - Post title and URL - Engagement metrics (score, comments) - Content flags (NSFW, spoiler, archived) - Media details: - For images: source URL, srcset, alt text - For videos: source URL, poster image, duration, dimensions ## 💡 Use Cases - Content curation and analysis - Social media monitoring - Market research - Trend analysis - Digital asset collection - Community engagement tracking - Visual content research - Meme tracking and analysis ## 🔧 Input Parameters | Parameter | Type | Description | |-----------|------|-------------| | query | String | Search keyword or phrase | | subReddit | String | Target subreddit name (without 'r/') | | sort | String | Sort results by: 'relevance', 'top', 'new', 'comments', or 'hot' | | time | String | Time range filter: 'hour', 'day', 'week', 'month', 'year', or 'all' | | safeSearch | String | Enable/disable safe search ('0' for safe, '1' for unsafe) | | maxItems | Integer | Maximum number of items to scrape | ### Input Example A full explanation of an input example in JSON. { "query": "ai", "subReddit": "ChatGPT", "sort": "relevance", "time": "all", "safeSearch": "0", "maxItems": 45 } ### Output sample The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. [ { "post_id": "t3_1ettmf9", "subreddit": "AppIdeas", "author_id": "t2_t4okkrvf", "created_time": "2024-08-16T16:42:26.663Z", "title": "I created a platform that gives you tasks based on the goals you want to achieve. Called https://plani.ai/", "type": "image", "url": "https://www.reddit.com/r/AppIdeas/comments/1ettmf9/i_created_a_platform_that_gives_you_tasks_based/", "score": 0, "comments": 8, "nsfw": false, "spoiler": false, "archived": false, "media_type": "image", "image": { "src": "https://preview.redd.it/i-created-a-platform-that-gives-you-tasks-based-on-the-v0-powbj1x412jd1.png?width=640&crop=smart&auto=webp&s=8e871070ac1afee2445314d781acef6dac720c31", "alt": "r/AppIdeas" } }, { "post_id": "t3_1emdp7k", "subreddit": "AppIdeas", "author_id": "t2_bpicyhlm", "created_time": "2024-08-07T14:47:33.839Z", "title": "Working on an idea to capture tasks using voice and then auto cateogize them with AI. I think this will be useful when you want to capture thoughts when driving or jogging. Let me know if this will be useful? Got plans of integrating it with Google Calendar and Trello, but that'll come later.", "type": "video", "url": "https://www.reddit.com/r/AppIdeas/comments/1emdp7k/working_on_an_idea_to_capture_tasks_using_voice/", "score": 7, "comments": 2, "nsfw": false, "spoiler": false, "archived": false, "media_type": "video", "video": { "poster": "https://external-preview.redd.it/working-on-an-idea-to-capture-tasks-using-voice-and-then-v0-Zjg3aml6dm04OWhkMekSC856TfBJbyYqHyM9L9mPIdzo9IlgPmCqbXrSpK3W.png?format=pjpg&auto=webp&s=d1584f39adc99497814286181d29c9fa83c0f216", "src": "https://packaged-media.redd.it/xpbem0wm89hd1/pb/m2-res_392p.mp4?m=DASHPlaylist.mpd&v=1&e=1730710800&s=3573eb993b5aed13269b7ee00be788708a11462e", "duration": 117, "dimensions": { "width": 202, "height": 392 } } }, ... ]