Sitemap Detector Effortlessly extract sitemap URLs from any website using this Sitemap Detector actor. It checks both robots.txt and common sitemap paths to find and return all available sitemap files — ideal for SEO audits, site structure analysis, or web crawling. --- ## Features - Extract sitemap URLs from robots.txt - Check fallback paths like /sitemap.xml, /sitemap_index.xml, etc. - Automatically normalizes domain formats (https, www, etc.) - Built-in proxy support for stealthy access - Fast and lightweight (async with Aiohttp) --- ## Input The actor accepts a single JSON input: json { "url": "example.com" } ### url (string) – Required The website domain or URL you want to extract sitemap(s) from. Examples: - example.com - https://www.example.com - http://example.com/ The input will be automatically normalized, so partial domains are acceptable. --- ## Output The output is a JSON object containing: | Key | Description | |------------------|---------------------------------------------------| | query | The original input provided | | normalized | Normalized version of the input URL | | sitemap_found | Boolean indicating if any sitemaps were found | | sitemap_urls | List of discovered sitemap URLs | ### Example Output: json { "query": "example.com", "normalized": "https://example.com", "sitemap_found": true, "sitemap_urls": [ "https://example.com/sitemap.xml", "https://example.com/sitemap_index.xml" ] }