GOAT Product Search Scraper

Scrapes product listings from GOAT.com, the authenticated sneaker and apparel marketplace. It automates data extraction for market research, price monitoring, and analysis, handling dynamic content and providing structured JSON output.

Overview

This actor scrapes product data from GOAT.com search and category pages. It's built for reliability, using proxy rotation and retry logic to navigate the site. You provide a list of GOAT URLs, and it returns detailed product information.

Key Features

• Reliable Execution: Automatic retry handling for failed requests.
• Proxy Support: Uses residential proxies (via Apify Proxy) to avoid blocking. You can specify a country (e.g., "US") for localized results.
• Configurable Limits: Set the maximum number of items to scrape per URL.
• Fault Tolerance: Option to continue scraping if individual URLs fail.
• Structured Output: Clean JSON data with essential product fields.

How to Use

Configure the actor using a JSON input. The core requirement is the urls array containing GOAT.com search or category pages.

Input Configuration

{
  "max_retries_per_url": 2,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
  },
  "max_items_per_url": 20,
  "urls": [
    "https://www.goat.com/sneakers",
    "https://www.goat.com/search?query=Jordan%204",
    "https://www.goat.com/apparel/outerwear"
  ],
  "ignore_url_failures": true
}

Input Parameters

• urls (Required): An array of GOAT.com product listing URLs to scrape.
• max_items_per_url: Limits the number of products scraped from each URL.
• max_retries_per_url: Number of retry attempts for a URL before giving up.
• ignore_url_failures: If true, the actor continues if a URL fails after retries.
• proxy: Configure Apify Proxy. Use RESIDENTIAL proxies and set apifyProxyCountry to match your target market.

Output

The actor outputs a dataset of items, where each item is a JSON object representing a product. Typical fields include:

• productUrl
• imageUrl
• name
• brand
• price
• condition
• styleId
• colorway
• retailPrice

The data is available in the Apify console for download as JSON, CSV, or via API.

Contact: For issues or questions, contact via My profile.