HTTP Status Codes and URL Checker

HTTP Status Codes and URL Checker

by antonio_espresso

A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizi...

1,556 runs
67 users
Try This Actor

Opens on Apify.com

About HTTP Status Codes and URL Checker

A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.

What does this actor do?

HTTP Status Codes and URL Checker is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

Apify HTTPS Status Checker 🚀 An Apify Actor that crawls websites and retrieves their HTTP status codes to help monitor site availability, detect broken links, and analyze redirects. --- ## 📌 FeaturesExtracts URLs from sitemaps if available. ✅ Crawls websites when no sitemap is found to collect URLs. ✅ Retrieves HTTP status codes for each discovered URL. ✅ Detects broken links (404 errors) and highlights them. ✅ Provides structured JSON output with status summaries. ✅ Ideal for SEO audits, website monitoring, and performance analysis. --- ## ⚙️ Input Parameters The actor accepts the following input in JSON format: json { "url": "https://example.com", "max_urls": 10, "follow_links": true, "mode": "auto" } | Parameter | Type | Description | |--------------|---------|-----------------------------------------------------| | url | String | The target URL or domain (required) | | max_urls | Integer | Maximum number of pages to analyze (default: 5) | | follow_links | Boolean | Whether to follow links in the crawl (default: false) | | mode | String | "sitemap", "crawl", or "auto" (default: "auto") | --- ## 📤 Output Format The actor returns structured JSON output with two key sections: ### 1️⃣ URL Details Each scanned URL along with its status code. json { "details": [ { "url": "https://example.com", "status": 200 }, { "url": "https://example.com/missing-page", "status": 404 } ] } ### 2️⃣ Status Code Summary Aggregates occurrences of each HTTP status code. json { "overview": [ { "Status Code": 200, "Count": 10 }, { "Status Code": 404, "Count": 2 } ] } --- ## 🚀 How to Run ### Option 1: Using Apify Console 1. Go to the Apify Actor Page. 2. Click Run and provide the input JSON. 3. Retrieve results from the Dataset Storage. ### Option 2: API Execution (cURL) Run the actor directly via API: sh cat > input.json <<'EOF' { "url": "https://example.com", "max_urls": 10, "follow_links": true, "mode": "auto" } EOF curl "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=$API_TOKEN" \ -X POST \ -d @input.json \ -H 'Content-Type: application/json' --- ## 🔍 Example Use Cases 💡 SEO Audits → Identify broken links and redirects. 💡 Website Monitoring → Track site uptime & status changes. 💡 Data Validation → Ensure external links are working. 💡 Content Management → Find outdated or broken content. --- ## 📚 Resources - Apify Docs - HTTP Status Codes Reference --- ## 🛠️ Author & Support Created by Antonio Blago antonioblago.de🛠️ 💬 Need help? Reach out via Apify Community ---

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try HTTP Status Codes and URL Checker now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
antonio_espresso
Pricing
Paid
Total Runs
1,556
Active Users
67
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support