HTTP Status Codes and URL Checker
by antonio_espresso
A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizi...
Opens on Apify.com
About HTTP Status Codes and URL Checker
A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.
What does this actor do?
HTTP Status Codes and URL Checker is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Apify HTTPS Status Checker 🚀 An Apify Actor that crawls websites and retrieves their HTTP status codes to help monitor site availability, detect broken links, and analyze redirects. --- ## 📌 Features ✅ Extracts URLs from sitemaps if available. ✅ Crawls websites when no sitemap is found to collect URLs. ✅ Retrieves HTTP status codes for each discovered URL. ✅ Detects broken links (404 errors) and highlights them. ✅ Provides structured JSON output with status summaries. ✅ Ideal for SEO audits, website monitoring, and performance analysis. --- ## ⚙️ Input Parameters The actor accepts the following input in JSON format: json { "url": "https://example.com", "max_urls": 10, "follow_links": true, "mode": "auto" } | Parameter | Type | Description | |--------------|---------|-----------------------------------------------------| | url | String | The target URL or domain (required) | | max_urls | Integer | Maximum number of pages to analyze (default: 5) | | follow_links | Boolean | Whether to follow links in the crawl (default: false) | | mode | String | "sitemap", "crawl", or "auto" (default: "auto") | --- ## 📤 Output Format The actor returns structured JSON output with two key sections: ### 1️⃣ URL Details Each scanned URL along with its status code. json { "details": [ { "url": "https://example.com", "status": 200 }, { "url": "https://example.com/missing-page", "status": 404 } ] } ### 2️⃣ Status Code Summary Aggregates occurrences of each HTTP status code. json { "overview": [ { "Status Code": 200, "Count": 10 }, { "Status Code": 404, "Count": 2 } ] } --- ## 🚀 How to Run ### Option 1: Using Apify Console 1. Go to the Apify Actor Page. 2. Click Run and provide the input JSON. 3. Retrieve results from the Dataset Storage. ### Option 2: API Execution (cURL) Run the actor directly via API: sh cat > input.json <<'EOF' { "url": "https://example.com", "max_urls": 10, "follow_links": true, "mode": "auto" } EOF curl "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=$API_TOKEN" \ -X POST \ -d @input.json \ -H 'Content-Type: application/json' --- ## 🔍 Example Use Cases 💡 SEO Audits → Identify broken links and redirects. 💡 Website Monitoring → Track site uptime & status changes. 💡 Data Validation → Ensure external links are working. 💡 Content Management → Find outdated or broken content. --- ## 📚 Resources - Apify Docs - HTTP Status Codes Reference --- ## 🛠️ Author & Support Created by Antonio Blago antonioblago.de🛠️ 💬 Need help? Reach out via Apify Community ---
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try HTTP Status Codes and URL Checker now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- antonio_espresso
- Pricing
- Paid
- Total Runs
- 1,556
- Active Users
- 67
Related Actors
Google Search Results Scraper
by apify
Google Search Results (SERP) Scraper
by scraperlink
Google Search
by devisty
Bing Search Scraper
by tri_angle
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support