WordPress Articles Scraper

Overview

This Apify actor extracts posts and metadata from WordPress sites using the WordPress REST API. It's built for developers, researchers, and content aggregators who need structured article data. The actor handles pagination automatically and can filter results by keyword.

Key Features

• Fetches posts from any public WordPress site.
• Automatically manages pagination to retrieve all available posts.
• Filters posts based on a search term.
• Extracts full post metadata: author, categories, tags, and featured image URLs.
• Outputs clean, structured JSON.

How to Use

Provide a WordPress site URL to start scraping. You can run the actor directly on Apify or via its API.

Using the Apify Interface:
1. Go to the actor's page on Apify.
2. Enter the required startUrls parameter.
3. Click Run.

Using the Apify API:

curl -X POST -H "Content-Type: application/json" \
-d '{"startUrls": [{"url": "https://example.com", "method": "GET"}]}' \
"https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=YOUR_API_TOKEN"

Input/Output

Input Parameters:
| Parameter | Type | Required | Description |
|-----------|------|----------|-------------|
| startUrls | Array | Yes | List of WordPress site URLs to scrape (e.g., [{"url": "https://example.com"}]). |

Output Format:
The actor returns a JSON dataset. Each item represents a post with the following structure:

{
  "id": 123,
  "date": "2025-03-28T12:00:00",
  "modified": "2025-03-28T14:00:00",
  "slug": "example-post",
  "link": "https://example.com/example-post",
  "title": "Example Post Title",
  "content": "<p>Post content...</p>",
  "excerpt": "Short summary...",
  "author": "Author Name",
  "categories": ["Category1", "Category2"],
  "tags": ["tag1", "tag2"],
  "featured_image": "https://example.com/image.jpg"
}

Common Use Cases:
* Aggregating content from multiple blogs.
* SEO research and content analysis.
* Creating datasets for NLP or data science projects.
* Backing up blog content.

For issues or contributions, refer to the actor's page on Apify.