Shopify Scraper Shopify Scraper is a professional-grade crawling tool designed to extract high-fidelity product data from any e-commerce store built on the Shopify platform. ## Why Use Shopify Scraper? - Market Research: Analyze competitor pricing, product descriptions, and variants to refine your own strategy. - Trend Monitoring: Track new product launches and stock status changes across multiple brands. - Data Aggregation: Build comprehensive catalogs by aggregating data from various Shopify-based niche stores. - Marketing Insights: Understand how successful brands structure their product metadata, including tags and categories. ## Key Features - 🚀 Store-wide Extraction: Capable of crawling an entire store's catalog, from collections to individual products. - 🎯 Precision Targeting: Fetch specific collections or singular product URLs with surgical precision. - 💱 Currency Normalization: Automatically handles currency selection and formats prices (multiplied by 100) to ensure financial accuracy without floating-point errors. - 📦 Comprehensive Data: Extracts everything: titles, descriptions, detailed detailed lists, images, options (size/color), and real-time stock status. - 🛡️ Resilience: Includes logic to bypass common gateway restrictions and handle "InStock"/"OutOfStock" parsing robustly. ## Important Note On certain Shopify websites, multiple SKUs may be visually merged into a single product page. Please be aware that this scraper treats each SKU as an individual product entry and does not perform any merging of these SKUs. ## How it Works ### 1. Verification Before running the scraper, verify your target is a Shopify store: 1. Navigate to https://<domain>/admin (e.g., https://gymshark.com/admin). 2. If you see a Shopify login page, the site is compatible. ### 2. Configuration The scraper accepts a JSON input defining the target URLs and scraping behavior. | Parameter | Type | Required | Description | | :--- | :--- | :--- | :--- | | startUrls | Array | Yes | A list of URLs to scrape (Homepage, Collection, or Product URLs). | | proxy | Object | Yes | Proxy configuration. Residential proxies are highly recommended to avoid blocks. | | maxResults | Integer | No | Limit the number of products scraped. Set to 0 for unlimited (default). | #### Input Example json { "startUrls": [ { "url": "https://uk.gymshark.com/collections/new-releases" } ], "proxy": { "useApifyProxy": true }, "maxResults": 500 } ### 3. Output Data is stored in the default dataset.

View Sample Output JSON

json { "source": { "id": "4857453543626", "canonicalUrl": "https://www.gymshark.com/products/gymshark-fraction-crop-top-light-green-white-logo", "retailer": "Gymshark | Be a visionary.", "language": "en", "currency": "USD", "createdUTC": 1613989955000, "updatedUTC": 1640058905000, "publishedUTC": 1614279501000 }, "title": "Gymshark Fraction Crop Top - Light Green", "brand": "Gymshark | Be a visionary.", "categories": ["Womens Crop Top"], "tags": ["crop-tops", "Womens"], "variants": [ { "id": "32686177550538", "title": "XS", "sku": "GLCT1844-CLM-XS", "price": { "current": 1500, "stockStatus": "InStock" } } ], "medias": [ { "type": "Image", "url": "https://cdn.shopifycdn.net/..." } ] }

--- ## Use Cases ### Fetch All Products Scrape every single product from the store. json { "startUrls": [ { "url": "https://uk.gymshark.com" } ], "proxy": { "useApifyProxy": true } } ### Fetch by Collection & Currency Scrape a specific collection ensuring prices are in USD. json { "startUrls": [ { "url": "https://uk.gymshark.com/collections/crop-tops?currency=USD" } ], "proxy": { "useApifyProxy": true } } --- ## Troubleshooting | Issue | Possible Cause | Solution | | :--- | :--- | :--- | | 0 Results Found | The site may not be Shopify-based or has strong anti-bot protection. | Verify with the /admin trick. Try using residential proxies. | | Access Denied / 403 | Your IP has been flagged. | Enable useApifyProxy and ensure you have sufficient proxy quota. | | Incorrect Price | Currency mismatch or raw integer format. | Remember prices are x100 (e.g., 2000 = 20.00). Ensure ?currency=XYZ param is used if supported. | ## Cost Estimation When running on Apify: - Compute Units: Depends on the site speed and number of products. Roughly 0.1-0.2 CUs per 1k products for optimized runs. - Proxy Bandwidth: Media rich sites will consume more bandwidth. Note: These are estimates and actual costs may vary.