SEO Data Extractor

An Apify actor that extracts structured SEO and technical metadata from webpages. It outputs comprehensive JSON data for audits, analysis, and monitoring.

Overview

This tool crawls specified URLs and returns a detailed breakdown of on-page SEO elements, Open Graph tags, Twitter Cards, technical headers, and content structure. It's designed for batch processing, handling errors gracefully, and optionally extracting sitemap data.

Key Features

• Meta & Content Data: Extracts title, description, keywords, robots directives, canonical URLs, and heading structure (H1-H6) with counts.
• Technical Analysis: Captures HTTP status, response time, charset, language, viewport, and structured data (JSON-LD).
• Social Metadata: Parses complete Open Graph and Twitter Card tags.
• Asset Audit: Identifies images (with alt text audit), favicons, and brand colors.
• Link Analysis: Counts total, internal, and external links.
• Sitemap Integration: Can optionally fetch and include all URLs from a domain's sitemap.xml.
• Scalable Execution: Built on the Apify platform for reliable, high-volume crawling.

How to Use

Configure the actor via input settings, typically through the Apify console, API, or SDK. The main parameters are:

• startUrls: (Array) The list of target URLs. Default is ["https://nocodeventure.com"].
• extractSitemapUrls: (Boolean) Set to true to fetch sitemap data for each domain.
• maxRequestsPerCrawl: (Integer) Limit total pages scraped (0 for unlimited). Default is 100.
• maxConcurrency: (Integer) Control parallel requests (1-50). Default is 10.
• proxyConfiguration: (Object) Use Apify Proxy or custom proxies to avoid blocks.

Input & Output

Input Configuration

The actor accepts a JSON input object. Key configuration fields are:

Output Schema

The result is a dataset of items, each a JSON object for a scraped page. The structure includes:

• Page Context: url, scrapedAt (ISO timestamp), and optional error/errorMessage fields.
• Meta Information: meta object with title, description, keywords, canonical, robots, and their character lengths.
• Headings: headings object with combined text and count for H1 through H6 tags.
• Content Data: wordCount, linkCount (broken into internal/external), and imageCount (including those missing alt text).
• Social & Technical Data: openGraph, twitterCard, structuredData, and technical (status code, response time, viewport, etc.) objects.
• Sitemap URLs: sitemapUrls array (present if extractSitemapUrls is enabled).

Example output snippet:

{
  "url": "https://example.com",
  "scrapedAt": "2023-10-26T10:30:00.000Z",
  "meta": {
    "title": "Example Page",
    "titleLength": 12,
    "description": "This is an example.",
    "descriptionLength": 19
  },
  "headings": {
    "h1": { "text": "Main Title", "count": 1 },
    "h2": { "text": "Subtitle One", "count": 1 }
  }
}