Medium User Posts Scraper

Scrapes detailed post data from public Medium user profiles. Provide a username, and it returns structured information about their articles, including metrics and metadata.

Key Features

• Scrapes posts from any public Medium profile.
• Extracts detailed post metrics: claps, responses, and reading time.
• Identifies premium (member-only) content.
• Captures publication dates, preview images, and author/collection details.
• Built with request optimization for efficient scraping.

How to Use

Configure the actor with input parameters and run it. Results are saved to the dataset in your Apify Storage tab, available for download in JSON, JSONL, CSV, Excel, HTML, or XML formats.

Input/Output

Input Parameters

Define your scrape in the actor's input configuration.

• usernames (Array, Required): List of Medium usernames to scrape.
• maxItems (Number): Maximum number of posts to retrieve per user.

Input Example:

{
  "usernames": ["mariaspantidi", "anotheruser"],
  "maxItems": 50
}

Output Data

The actor outputs an array of objects, one for each scraped post. Each object contains the following key fields:

• username: The profile's Medium username.
• id, title, subtitle, url: Core post identifiers.
• readingTime, clapCount, responseCount: Engagement metrics.
• isLocked: Boolean indicating premium content.
• firstPublishedAt, latestPublishedAt: Publication timestamps.
• previewImage: URL of the post's preview image.
• creator: Object with author id, name, username, and bio.
• collection: Object with publication name, description, and subscriberCount (if applicable).
• scrapedAt: Timestamp of when the data was collected.

Output Sample:

[
  {
    "username": "yaelwolfe",
    "id": "5c510f575964",
    "title": "What Does It Mean to Write Women’s Fiction?",
    "subtitle": "A female writer’s musings on the challenges of an imposed niche",
    "url": "https://medium.com/wilder-with-yael-wolfe/what-does-it-mean-to-write-womens-fiction-5c510f575964",
    "readingTime": 9,
    "isLocked": true,
    "clapCount": 2515,
    "responseCount": 49,
    "firstPublishedAt": "2024-11-03T16:44:42.880Z",
    "previewImage": "https://miro.medium.com/v2/resize:fill:320:214/1*X1YZ5fw1y51ytJvBArdhMA.jpeg",
    "creator": {
      "name": "Y.L. Wolfe",
      "username": "yaelwolfe"
    },
    "collection": {
      "name": "Wilder",
      "subscriberCount": 675
    },
    "scrapedAt": "2024-11-06T16:44:42.880Z"
  }
]