RapidAPI Scraper

Name: RapidAPI Scraper
Author: yourapiservice

by yourapiservice

Scrape API listings, metadata, and descriptions from RapidAPI by category. Export data, run via API, schedule jobs, and integrate the results effortlessly.

866 runs

59 users

Try This Actor

Opens on Apify.com

About RapidAPI Scraper

Need to pull data from RapidAPI for a project? This scraper does the heavy lifting for you. I've used it to gather API listings by category or specific collection, pulling down names, descriptions, and all the key metadata you need to evaluate options. Just set your search parameters and let it run. It's perfect for building a directory, conducting market research on available APIs, or feeding data into your own comparison tools. You get clean, structured data ready for analysis. Running it is straightforward—fire it up via the API, schedule regular runs to keep your data fresh, or monitor everything from a dashboard. The real time-saver is the easy export; you can push the scraped data directly into other apps and workflows without manual hassle. It just works, letting you focus on using the information instead of fighting to collect it.

What does this actor do?

RapidAPI Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

Cloud-based execution - no local setup required
Scalable infrastructure for large-scale operations
API access for integration with your applications
Built-in proxy rotation and anti-blocking measures
Scheduled runs and webhooks for automation

How to Use

Click "Try This Actor" to open it on Apify
Create a free Apify account if you don't have one
Configure the input parameters as needed
Run the actor and download your results

Documentation

RapidAPI Scraper

Overview

This actor scrapes API listings from RapidAPI, which doesn't provide a comprehensive public API list. It extracts structured data about APIs, including categories, collections, and detailed endpoint information, for use in your own applications, directories, or reports.

Key Features

Scrapes the complete list of APIs from RapidAPI, with or without category/collection filtering.
Extracts detailed API information: title, description, categories, pricing, stats (builds, runs, users), and owner.
Can scrape deep technical details like endpoints, methods, parameters, and headers.
Outputs data in multiple structured formats: JSON, CSV, Excel, XML, HTML.
Configurable scraping limits and sorting options.
Supports proxy configuration (Apify Proxy, custom proxies, or no proxy).

How to Use

Run the actor on the Apify platform, where a UI helps configure inputs. The scraped data can be used to:
* Build new applications or services that leverage the RapidAPI catalog.
* Create a developer-focused API directory or marketplace.
* Generate reports and analyses of API availability and trends.

Input/Output

Input Parameters

Configure the scraper using these main parameters:

includeCategories / includeCollections: Set to true to scrape by categories or collections first.
categoryNames / collectionNames: Arrays of specific categories or collections to scrape (e.g., ["Finance", "Data"]).
maxItemsPerCategory: Limit the number of results per category/collection.
sortBy: Sort results (e.g., "ByTrending").
scrapeDetails, scrapeEndpoints, scrapeAllDetails: Enable deeper scraping of API specs. Note: Enabling these, especially with proxies, can significantly increase run time.
proxyConfiguration: Set to APIFY_PROXY_CONFIGURATION, YOUR_PROXY_CONFIGURATION, or NO_PROXY.

Example Input:

{
  "includeCategories": true,
  "categoryNames": ["Finance", "Data"],
  "maxItemsPerCategory": 100,
  "sortBy": "ByTrending",
  "scrapeDetails": false
}

Output

Results are saved to a dataset. Each item represents one API with a structure like this:

{
  "source": "RapidAPI",
  "title": "Seeking Alpha",
  "name": "seeking-alpha",
  "username": "apidojo",
  "description": "Query for news, market moving, price quotes...",
  "categories": ["Finance"],
  "pictureUrl": "https://...",
  "stats": {
    "totalBuilds": 0,
    "totalRuns": 1341,
    "totalUsers": 43
  }
}

You can download this data from the dataset in your preferred format (JSON, CSV, Excel, etc.) via the Apify console.