Restore failed requests
by onidivo
Automatically retry failed web scraping requests. Pull URLs from a dataset back into a queue for a second attempt, saving time and data.
Opens on Apify.com
About Restore failed requests
Ever had a web scraping run fail partway through, leaving you with a dataset full of URLs you still need to process? It's a frustrating waste of time and resources. This actor is built for exactly that scenario. It lets you take the failed requests logged in a run's dataset and push them back into a request queue, ready for another attempt. Think of it as a second chance for your crawler. Instead of manually sifting through error logs or restarting the entire job from scratch, you can efficiently retry only the problematic URLs. This is incredibly useful for handling temporary network glitches, server timeouts, or anti-bot blocks that might resolve on a second pass. You can integrate it into your workflow to create more resilient, fault-tolerant automation. Just point it to the source dataset and a target request queue, and it handles the rest. It saves you from losing valuable data and keeps your projects moving forward without manual intervention. I've used it to recover runs that hit unexpected rate limits, and it turned a potential headache into a minor, automated pause.
What does this actor do?
Restore failed requests is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Restore Failed Requests
An Apify actor that restores failed requests from a dataset. It reads a dataset, identifies items that failed based on a specific request ID, and restores those requests for reprocessing.
Key Features
- Recovery from Datasets: Scans a specified dataset to find failed request entries.
- Targeted Restoration: Uses a configurable "Request ID Path" to pinpoint which items represent failed requests.
- Automated Reprocessing: Automatically restores the identified requests, making them available for another run.
How to Use
- Configure the Actor: Set the
datasetIdof the dataset containing your run's data. - Specify the ID Path: Provide the
requestIdPath. This is the property path within each dataset item where the request ID is stored (e.g.,request.id). - Run the Actor: Execute it. The actor will read the dataset, find items with request IDs at the given path, and restore those specific requests.
Input/Output
Input Configuration:
* datasetId (String, Required): The ID of the dataset to scan for failed requests.
* requestIdPath (String, Required): The JSON path to the request ID within a dataset item.
Output:
The actor does not produce a new dataset. Its primary output is the side effect of restoring the failed requests to the run's request queue, allowing them to be retried. Check the actor run log for details on how many requests were identified and restored.
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Restore failed requests now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- onidivo
- Pricing
- Paid
- Total Runs
- 210
- Active Users
- 17
Related Actors
Web Scraper
by apify
Cheerio Scraper
by apify
Website Content Crawler
by apify
Legacy PhantomJS Crawler
by apify
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support