GitHub Marketplace Scraper

This Apify actor scrapes application listings from the GitHub Marketplace. It extracts structured data like app details, developer info, pricing, and install counts, which is useful for market research and competitive analysis.

Key Features

• Crawls Search Results: Loads and parses listings from GitHub Marketplace based on a search query.
• Extracts App Metadata: Captures the app name, description (short and long), logo URL, and categories.
• Gathers Developer Info: Retrieves the developer name, support email, and privacy policy link.
• Captures Pricing & Stats: Collects available pricing plans and the number of installs.
• Built for Reliability: Uses proxy support and session management to handle larger scraping jobs and reduce blocking risk.

How to Use

The actor runs automatically with a predefined search query and does not require user input.

1. Run the actor on the Apify platform.
2. The scraper will crawl the GitHub Marketplace, extract data from each listing, and push the results to an Apify dataset.
3. Once finished, you can export the dataset in JSON, CSV, or Excel formats for further processing.

Input/Output

Input: This actor currently uses a hardcoded search query and does not accept input parameters.

Output: The actor outputs a structured JSON object for each marketplace listing. The format is shown below.

{
  "app_name": "Sample App",
  "developer_name": "Sample Developer",
  "description": "Short description.",
  "description_long": "A more detailed description of the app.",
  "logo_url": "https://example.com/logo.png",
  "number_of_installs": 5000,
  "privacy_policy": "https://example.com/privacy",
  "support_email": "support@example.com",
  "categories": [
    {"name": "DevOps"},
    {"name": "Security"}
  ],
  "plans": [
    {"name": "Basic", "price": "$10/month"},
    {"name": "Pro", "price": "$50/month"}
  ],
  "app_url": "https://github.com/marketplace/sample-app"
}

Customization & Resources

If you need to modify the scraper, such as adding new data fields or changing the target query, you can file an issue to request a custom build.

For technical details on building actors, refer to the Apify SDK Documentation and Crawlee Documentation.