Apify Store Scraper

Overview

This is an Apify actor for scraping data about actors from the Apify Store. It extracts detailed information from store listings, category pages, or search results. Built on the Apify SDK, it can run on the Apify platform or locally.

Key Features

• Scrapes actor details like title, description, usage stats, and source URLs.
• Configurable search via start URLs (store homepage, category pages, or direct actor links).
• Customizable output via an extendOutputFunction.
• Includes proxy support (Apify Proxy by default).
• Output is saved to a dataset for easy access and export.

How to Use

Configure the actor using the input fields below, then run it. The scraper will crawl the provided URLs and extract actor data up to the specified maxItems.

Input

Configure the run with these fields:

Output

The dataset contains items with actor details. Example item:

{
  "title": "Apify Store Scraper",
  "url-title": "lukaskrivka/apify-store-scraper",
  "sourceUrl": "https://github.com/metalwarrior665/apify-store-scraper",
  "usedTimes": 50000,
  "description": "Scrape all information about actors in Apify Store!"
}

Extending Output

Use extendOutputFunction to customize the scraped data. The function takes a jQuery handle ($) and must return an object. You can:
- Add a field: Return a new key-value pair.
- Change a field: Return an existing key with a new value.
- Remove a field: Return an existing key with value undefined.

Example function:

($) => {
    return {
        title: $('.fxqkUh p').eq(0).text(),
        'url-title': undefined,
        modified: $('.stats time').eq(0).text(),
    }
}

This would modify the title, remove url-title, and add a new modified field.

Compute Units

Average consumption is 1 Compute Unit per 1000 actor pages scraped. For efficiency, run longer scrapes (at least one minute) to minimize startup overhead.

Support

For feedback or bug reports, email lukas@apify.com or create an issue on the GitHub page.