CSFD Scraper

A fast, efficient web scraper for static HTML pages on csfd.cz. Built with Rust, it scrapes without rendering pages, using minimal memory (128 MB) to maximize Apify credit efficiency. Benchmark data is available at https://apify.com/danielherman/fast-scraper.?fpr=python_automation

Key Features

• High Performance: Rust backend enables fast scraping of static HTML.
• Low Resource Usage: Operates within a 128 MB memory limit.
• Credit Efficient: Designed to minimize compute consumption on Apify.
• Concurrent Processing: Configurable concurrency for parallel requests.
• Flexible Request Handling: Supports per-request headers and user-agent overrides.

How to Use

Configure the actor via the Input tab. The core of the input is a requests array, where each request object specifies what to scrape.

Request Structure

{
  "request_type": "string", // Required
  "url": "string",          // Optional (required for most types)
  "id": "string",           // Optional custom identifier for tracking
  "headers": {},            // Optional request-specific headers
  "user-agent": "string"    // Optional request-specific user agent
}

Only request_type is mandatory. The url field is required for most types but ignored for Sitemap. The id is passed through to the output for request tracking. Request-level headers and user-agent override any globally set values.

Supported Page Types (request_type)

• Sitemap: Scrapes all URLs from the exposed csfd.cz sitemap. Runs as a single request.
• View: Extracts information from movie, serial, series, or episode overview pages (URLs containing /prehled).
• ViewReviews: Retrieves comments for a specific movie, serial, series, or episode.
• User: Gets information about a user profile.
• UserReviews: Fetches a user's reviews.
• Ratings: Scrapes all user ratings for a specific title.

Planned types: Creator, Program.

Input/Output

Input Configuration

Global parameters apply to all requests but can be overridden at the request level.

{
  "requests": [ /* Array of request objects */ ],
  "headers": { /* Global HTTP headers */ },
  "user_agent": "Mozilla/5.0...",
  "force_cloud": false,
  "push_data_size": 500,
  "max_concurrency": 10,
  "max_request_retries": 3,
  "max_request_retry_timeout_ms": 10000,
  "request_retry_wait_ms": 5000
}

Note: Global headers cannot be deleted at the request level, only overridden with new values.

Output

Scraped data is pushed to the dataset. The order of results in the output will likely differ from the order of requests in the input array. Each output item will include the id field if one was provided in the corresponding request.