O’Reilly Auto Scraper

This actor scrapes product data from OReillyAuto.com. It handles search results, category pages, and individual product detail pages, extracting structured information like pricing, availability, and specifications. The scraper is built to handle the site's client-side rendered content.

Key Features

• Multi-Point Scraping: Starts from search queries, category listings, or direct product URLs.
• Structured Data Extraction: Captures product title, brand, SKU, price, availability, images, and detailed specifications.
• Dynamic Content Handling: Retrieves real-time, JavaScript-rendered data such as pricing and stock info.
• Proxy Support: Configurable proxy settings for reliable, large-scale scraping.

How to Use

Configure the actor run via the input schema. The primary method is to provide one or more startUrls. You can also use a query for a direct search.

Example Input:

{
  "startUrls": [
    { "url": "https://www.oreillyauto.com/search?q=brake+pads" },
    { "url": "https://www.oreillyauto.com/detail/c/slime/slime-inner-tubes/sli0/30011" }
  ],
  "maxItems": 50,
  "proxyConfiguration": { "useApifyProxy": true }
}

Configuration Fields:
* startUrls: (Array) List of URLs to scrape. Can be search, category, or product pages.
* query: (String) A search term. The actor will scrape results for this query.
* maxItems: (Number) Limit the total number of products scraped.
* proxyConfiguration: (Object) Configure proxies; useApifyProxy is recommended.

Note: For optimal performance, allocate at least 4GB of memory to the actor.

Input & Output

Input: Accepts a JSON object defining the crawl starting points and limits, as shown in the example above.

Output: The actor returns a dataset of structured product objects. Each item contains fields like id, sku, title, brand, price, url, description, images, and detailed specifications.

Example Output Item:

{
  "id": "716281000942",
  "sku": "716281000942",
  "title": "Slime Inner Tubes",
  "brand": "Slime",
  "price": 20.99,
  "url": "https://www.oreillyauto.com/detail/c/slime/slime-inner-tubes/sli0/30011",
  "primaryImageUrl": "https://images.oreillyauto.com/parts/img/extralarge/sli/30011_front.jpg",
  "inStock": true
}

The data is suitable for price monitoring, inventory analysis, market research, and building product databases.