Bike Components Scraper

Overview

This Apify actor scrapes product data from bike-components.de, a major online retailer for cycling parts and accessories. It extracts detailed information from product pages, including pricing, specifications, and inventory details, and outputs structured data in JSON format.

Key Features

• Scrapes a comprehensive set of fields from bike-components.de product pages.
• Handles product variants like colors and sizes.
• Outputs clean, structured data with field names in snake_case.
• Runs on the Apify platform, handling scaling, proxies, and CAPTCHAs.

Data Fields Scraped:
* Core Info: name, brand, categories, prices, image_urls
* Variants: colors, sizes
* Descriptions: product_description, comments, notes
* Specifications: specifications, components, technical_information, weight, dimensions
* Manufacturer Details: manufacturer, manufacturer_number, manufacturer_notice
* Additional Info: characteristics, compatibility, features, hazard_warnings, safety_information

How to Use

1. Run the actor on its Apify page (click "Try for free").
2. Configure the Start URLs input with the URLs of the product listings or category pages you want to scrape from bike-components.de.
3. Adjust other run parameters if needed (like max pages).
4. Click "Start". The actor will crawl the site and extract data.
5. Download your dataset in JSON, CSV, or other formats from the Apify dataset storage once the run completes.

Input/Output

Input: Provide one or more start URLs pointing to bike-components.de product listing pages.

Output: The actor returns a dataset where each item is a product. Each item contains the scraped fields as key-value pairs. The primary output format is JSON.

{
  "name": "Example Bike Helmet",
  "brand": "BrandX",
  "categories": ["Helmets", "Safety"],
  "price": "89.99",
  "colors": ["Red", "Black"],
  "sizes": ["M", "L"],
  "product_description": "A lightweight helmet...",
  "image_urls": ["https://...image1.jpg"],
  "manufacturer": "BrandX GmbH",
  "weight": "280g"
}