Menicka Crawler

A web crawler built on Apify for extracting restaurant menu data. It uses PlaywrightCrawler to handle dynamic content and JavaScript-rendered pages.

Overview

This actor is designed to systematically crawl restaurant websites to collect structured menu information, including dish names, descriptions, prices, and categories. It's built with Crawlee and Playwright for reliable data extraction.

Key Features

• Dynamic Content Handling: Uses Playwright to interact with and scrape modern JavaScript-heavy websites.
• Recursive Crawling: Follows links within defined patterns to discover all relevant menu pages.
• Structured Data Output: Returns clean, organized data in JSON format, ready for analysis or integration.
• Apify Platform Integration: Runs on the Apify platform with built-in features for scaling, scheduling, and storage.

How to Use

You can run the actor on the Apify platform. Configure your run using the input schema, which typically includes:

• Start URLs: The restaurant website URLs to begin crawling from.
• Link Patterns: (Optional) Regex patterns to control which internal links the crawler should follow.
• Max Depth/Pages: Limits to control the crawl scope.

For local development or customization:
1. Clone the actor's source code.
2. Install dependencies with npm install.
3. Configure your start URLs in the main.js file or via input.
4. Run it locally with npm start or build and push it to your Apify account.

Refer to the Crawlee tutorial and PlaywrightCrawler API docs for detailed development guidance. More examples are available in the Crawlee docs.

Input/Output

Input (JSON):

{
  "startUrls": ["https://example-restaurant.com/menu"],
  "maxCrawlDepth": 3,
  "maxCrawlPages": 100
}

Output:
The actor outputs a dataset of menu items. Each item is a structured object. The default dataset is available in Apify storage as JSON, with each item resembling:

{
  "restaurantName": "Example Restaurant",
  "dishName": "Sample Dish",
  "description": "Ingredients and description here.",
  "price": "15.50",
  "category": "Main Courses",
  "url": "https://example-restaurant.com/menu/main-courses"
}