Costco Product Details Scraper (.com, .ca)

Overview

This actor scrapes detailed product information from Costco's US (.com) and Canadian (.ca) websites. It handles JavaScript-rendered content and anti-bot protections to extract data like pricing, specifications, and ratings into structured JSON.

Key Features

• Multi-region support: Works with both costco.com and costco.ca.
• Dynamic content handling: Executes JavaScript and processes AJAX-loaded data.
• Anti-bot evasion: Uses residential proxies (via Apify Proxy) to avoid detection.
• Comprehensive data extraction: Captures product name, SKU, model number, price, rating, features, and more.
• Configurable retries: Handles failed requests with adjustable retry logic.

How to Use

Configure the actor with a JSON input specifying the product URLs and proxy settings. The actor will process each URL and return the scraped data to the dataset.

Input/Output

Input

Provide a JSON object with the following structure:

{
  "max_retries_per_url": 2,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "SG"
  },
  "urls": [
    "https://www.costco.com/roland-frp-nuvola-ex-digital-piano-bundle.product.4000385725.html",
    "https://www.costco.ca/singing-machine-ultimate-karaoke-party-system.product.4000371572.html"
  ]
}

• urls: An array of Costco product page URLs.
• proxy: Configuration for Apify Proxy. Use RESIDENTIAL proxy groups and set the country to match your target region (e.g., "US" for .com, "CA" for .ca).
• max_retries_per_url: Number of retry attempts for failed requests.

Output

The actor outputs a JSON object for each product. Each record contains fields such as:
* url, title, sku, modelNumber
* price, wasPrice, memberOnlyPrice
* rating, reviewCount
* description, specifications (key-value pairs), features (array)
* imageUrls, breadcrumbs, inStock

Example output record:

{
  "url": "https://www.costco.com/example-product.html",
  "title": "Example Product Name",
  "sku": "1234567",
  "price": 299.99,
  "inStock": true,
  "specifications": {
    "Brand": "ExampleBrand",
    "Weight": "10 lbs"
  }
}

For support, contact the developer via My profile.