OMR Review Scraper

A Node.js template Actor for scraping structured data from a single web page. You provide a URL via input, and the Actor fetches the HTML, parses it, and outputs the extracted data to a dataset. It's built on Apify SDK and uses Axios for HTTP requests and Cheerio for HTML parsing.

Key Features

• Apify SDK: Provides the scaffolding for building, running, and managing the Actor.
• Input Schema: Validates run input, requiring a url field by default.
• Structured Output: Stores scraped results in an Apify dataset for easy access and export.
• Axios & Cheerio: Reliable HTTP client paired with a fast, jQuery-like HTML parser.
• Customizable: The parsing logic is simple JavaScript and can be modified to extract any data from the page.

Input / Output

Input (via Actor.getInput()):
The Actor expects a JSON object containing the target page's URL.

{
  "url": "https://example.com/page-to-scrape"
}

Output:
Scraped data is stored in the run's default dataset. The default code extracts page headings, producing items like:

{
  "heading": "Example Domain",
  "level": "h1"
}

You change the Actor.pushData() call to store whatever data your scraper extracts.

How to Use

Basic Workflow

1. Configure Input: Set the url in the Actor's input configuration.
2. Run the Actor: Start the run via the Apify Console, API, or CLI.
3. Get Results: Access the scraped data from the dataset in the Console, or via the Apify API.

How It Works (Code Flow)

The core scraping logic follows these steps:
1. Fetches the input object to get the target URL.
2. Uses axios.get() to download the page HTML.
3. Loads the HTML into Cheerio with cheerio.load() for parsing.
4. Extracts data using Cheerio selectors (e.g., $('h1')). This is the part you edit for your use case.
5. Saves the structured results using Actor.pushData().

Local Development

To modify the Actor locally, use the Apify CLI to pull the source code.

1. Install Apify CLI:
   bash npm -g install apify-cli
   or
   bash brew install apify-cli

2. Pull the Actor: Use its unique name or ID (found in the Apify Console).
   bash apify pull <ActorId>

Resources

• Apify SDK for JavaScript documentation
• Apify Platform documentation
• Tutorial: Web scraping in Node.js with Axios and Cheerio
• Join our developer community on Discord