Reddit Post Scrapper

Reddit Post Scraper A powerful and configurable Reddit post scraper built with Apify, AsyncPRAW, and proper proxy handling for reliable data collection. Overview This tool allows you to scrape Reddit posts and their comments with high reliability by utilizing rotating residential proxies through Apify's proxy infrastructure. It's designed to be respectful of Reddit's servers while maintaining a high success rate even under restrictive environments. Features Robust Proxy Handling: Uses Apify's proxy infrastructure with residential IPs to avoid rate limiting and IP blocks Comprehensive Post Data: Collects post titles, descriptions, comments, and comment replies Configurable Limits: Easily adjust the number of posts and comments to scrape Reddit API Integration: Uses AsyncPRAW for proper API interaction Fallback Mechanisms: Built-in error handling and recovery Rate Limiting Protection: Implements random delays and best practices to avoid detection Troubleshooting API Rate Limiting: If you see rate limiting errors, increase the wait times between requests Proxy Issues: Ensure your Apify account has access to residential proxies Authentication Problems: Double-check your Reddit API credentials Legal Note This tool is provided for educational purposes only. Always comply with Reddit's Terms of Service and API Terms. Be respectful of their servers and don't use this tool for scraping content on a large scale without proper authorization. License MIT License - See LICENSE file for details.