Download HTML from URLs
by scrapeai
This actor takes a list of URLs and downloads HTML of each page.
Opens on Apify.com
About Download HTML from URLs
This actor takes a list of URLs and downloads HTML of each page.
What does this actor do?
Download HTML from URLs is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
๐ง HTML Downloader This Apify actor takes a list of URLs and downloads the full HTML content of each page. It simply scrapes the complete HTML code for all given URLs. You can define proxy settings and optional selector waiting. โ
Use Cases ๐ Download HTML content from multiple websites ๐ท๏ธ Archive web pages for offline analysis ๐ Extract raw HTML for custom parsing ๐ Monitor website changes over time ๐ฅ Input Configuration You can customize the actor using the following input fields: json { "requestListSources": [ { "url": "https://apify.com" } ], "proxyConfiguration": { "useApifyProxy": true }, "handlePageTimeoutSecs": 60, "maxRequestRetries": 1, "useChrome": false } ๐งพ Fields Explained Field Type Description requestListSources array Required. Array of URLs to download. Each item can have optional userData with waitForSelector proxyConfiguration object Proxy settings - choose no proxy, Apify Proxy, or custom proxy URLs handlePageTimeoutSecs integer Optional. Maximum time to spend processing one page (default: 60) maxRequestRetries integer Optional. How many retries before giving up (default: 1) useChrome boolean Optional. Use real Chrome browser instead of Chromium (default: false) ๐ค Output The actor returns a dataset containing HTML content for each URL. Each record includes the original URL, final URL (after redirects), page title, and full HTML content. ๐งฉ Sample Output json [ { "url": "https://apify.com", "loadedUrl": "https://apify.com/", "title": "Apify - Web Scraping & Data Extraction | Apify", "html": "<!DOCTYPE html>\n<html lang=\"en\">\n<head>\n<meta charset=\"utf-8\">\n..." } ] ๐ Proxy Configuration This actor supports flexible proxy configuration: No proxy (default) Apify Proxy for residential IPs Custom proxy URLs Default proxy settings: json { "useApifyProxy": true } ๐ How to Use Open the actor in Apify Console Click "Try actor" or create a new task Add URLs to the requestListSources array Configure proxy settings if needed Run the actor Download HTML content in JSON, CSV, or XML format โ๏ธ Advanced Input Example json { "requestListSources": [ { "url": "https://example.com", "userData": { "waitForSelector": ".content-loaded" } }, { "url": "https://another-site.com" } ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }, "handlePageTimeoutSecs": 120, "maxRequestRetries": 3, "useChrome": true } ๐ ๏ธ Tech Stack ๐งฉ Apify SDK โ for actor and data handling ๐ท๏ธ Crawlee โ for robust crawling and scraping ๐ Puppeteer โ for browser automation and rendering dynamic content โ๏ธ Node.js โ fast, scalable backend environment
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Download HTML from URLs now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- scrapeai
- Pricing
- Paid
- Total Runs
- 21
- Active Users
- 3
Related Actors
Similarweb scraper
by curious_coder
Google Ads Scraper
by silva95gustavo
Cheap Google Search Results Scraper
by tuningsearch
G2 Explorer
by jupri
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support