Product Hunt Leaderboard Scraper

This Apify actor scrapes the Product Hunt leaderboard to extract structured data about top-ranked products. It's designed for lead generation, market research, and trend analysis.

Overview

The actor programmatically visits the Product Hunt leaderboard pages (Today, Yesterday, This Week, All Time) and extracts key details for each listed product. It handles pagination to gather comprehensive results and outputs clean, structured data in JSON format, suitable for databases or spreadsheets.

Key Features

• Multi-Timeframe Scraping: Collects data from four leaderboard categories: Today, Yesterday, This Week, and All Time.
• Pagination Handling: Automatically navigates through all pages of a selected leaderboard to get complete results.
• Structured Data Extraction: Captures consistent product fields including votes, comments, and ranking.
• Multiple Output Formats: Results are available as a dataset on the Apify platform and can be downloaded as JSON, CSV, Excel, XML, or HTML.
• Configurable Scope: You can limit scraping to a specific number of pages or products.

How to Use

Run the actor on the Apify platform. Configure it using the input options below, then start the run. Once finished, you can view and download the scraped dataset from the actor's run console.

Input Configuration

Configure the actor using the following input fields (typically as a JSON object):

{
  "leaderboardType": "today",
  "maxPages": 1,
  "maxProducts": 0
}

• leaderboardType (String): Required. The leaderboard to scrape. Choose from:
  • "today"
  • "yesterday"
  • "this_week"
  • "all_time"
• maxPages (Integer): The maximum number of leaderboard pages to process. Default is 1. Set to 0 to scrape all available pages.
• maxProducts (Integer): The maximum total number of products to scrape across all pages. Default is 0 (no limit).

Input/Output

Input

The actor requires the leaderboardType parameter. The other parameters (maxPages, maxProducts) are optional for controlling the run's scope and duration.

Output

The actor outputs an array of items, where each item represents a product from the leaderboard. The dataset is stored in your Apify account and includes the following fields for each product:

• id: The Product Hunt internal ID for the product.
• name: The product's name/title.
• tagline: The product's descriptive tagline.
• url: The direct link to the product's page on Product Hunt.
• votesCount: The total number of upvotes.
• commentsCount: The total number of comments.
• productImageUrl: URL of the product's featured image.
• productSlug: The URL slug identifier for the product.
• rank: The product's numerical rank on the leaderboard (e.g., 1, 2, 3).
• leaderboardType: Which leaderboard this data was sourced from (e.g., "today").
• pageUrl: The specific leaderboard page URL where this product was found.

You can access the results via the Apify API or download them directly from the run console in your preferred format.