⚡ Shopify Product Scraper – Ultra-Fast Full-Catalog Extractor This Apify actor scrapes complete product catalogs from any Shopify-powered store at lightning speed. It accesses Shopify’s public products.json API, bypassing slow HTML parsing and browser overhead. It supports bulk store URLs, auto-handles pagination (250 products/page), maps variants to images, extracts gendered size lists, and outputs a clean, structured dataset. --- ## Get 10k Products For Just 0.09$ and in 7-8 Mins --- ## 🚀 What It Does For every product in a Shopify store, the actor extracts: - 🆔 Product ID & Handle - 📦 Title & Clean Description - 💰 Price Range (min/max & currency) - 🏷️ Vendor, Type & Tags - 🎨 Options (Color, Size, Material, etc.) - 🖼️ High-resolution images - 📅 Created / Updated / Published dates - 🔢 Variant Summary - total variants - available count - percent available - 👟 Smart Size Lists - Men’s Available Sizes - Women’s Available Sizes - Unisex sizes - 📋 Full Variant Breakdown - SKU - Title - Size / Color - Price & Compare-at Price - Stock availability - Variant image --- ## ⚡ It Handles - ✅ Bulk Shopify store URLs - 🔄 Automatic pagination (250 products per page) - 🧹 Smart data cleaning (gender detection, size grouping) - 🎨 Variant → Image mapping - ⚡ 10x–50x faster than browser scrapers - 🌐 Automatic Apify Proxy (no config needed) - 🛡️ Retry & error handling - 📦 Dataset is cleaned and structured before saving --- ## 🧠 How It Works 1. Loads your Shopify store URLs 2. Appends /products.json with pagination parameters 3. Fetches products in batches of 250 4. Continues until all pages are completed 5. Normalizes the data: - maps variants - extracts gender - builds readable size lists - generates min/max price range 6. Saves all product data in a consistent, structured format 7. (Optional) Stops early if maxItems limit is reached --- ## ⚙️ Input Configuration | Field | Type | Description | Example Value | | -------------------- | ------- | -------------------------------------------------- | -------------------------------------------------- | | startUrls | Array | Shopify store URLs to scrape | ["https://allbirds.com", "https://gymshark.com"] | | maxItems | Integer | Optional product limit per store (0 = unlimited) | 1000 | | proxyConfiguration | Object | Proxy settings (Apify Proxy recommended / default) | { "useApifyProxy": true } | --- ## 🧩 Example Input json { "startUrls": [{ "url": "https://www.allbirds.com" }], "maxItems": 500, "proxyConfiguration": { "useApifyProxy": true } } --- ## 📊 Example Output json { "sourceUrl": "https://www.allbirds.com", "productId": 7193764298832, "title": "Women's Tree Dasher 2 - Rugged Beige (Stony Cream Sole)", "handle": "womens-tree-dashers-rugged-beige-stony-cream", "url": "https://www.allbirds.com/products/womens-tree-dashers-rugged-beige-stony-cream", "description": "The Tree Dasher 2 is the next evolution of our everyday active shoe with more responsive foam, extra grip, and an improved fit to keep you moving, and nature winning.", "gender": "Women's", "vendor": "Allbirds", "type": "Shoes", "tags": [ "allbirds::carbon-score => 5.48", "allbirds::cfId => color-3aed57948cd5460f448555993790ea71", "allbirds::complete => true", "allbirds::edition => limited", "allbirds::gender => womens", "allbirds::hue => beige", "allbirds::master => womens-tree-dashers", "allbirds::material => tree", "allbirds::price-tier => tier-2", "allbirds::silhouette => dasher", "allbirdskit::kit-discount-20whQOueHm7zwKfR8Csr2c => 23", "allbirdskit::kit-id => 20whQOueHm7zwKfR8Csr2c", "allbirdskit::kit-size-20whQOueHm7zwKfR8Csr2c => 2", "loop::returnable => true", "shoprunner", "YCRF_womens-perform-shoes", "YGroup_ygroup_womens-tree-dashers" ], "Women's Available Sizes": ["5"], "color": "Rugged Beige", "options": [ { "name": "Color", "values": ["Rugged Beige"] }, { "name": "Size", "values": [ "5", "5.5", "6", "6.5", "7", "7.5", "8", "8.5", "9", "9.5", "10", "10.5", "11" ] } ], "images": [ { "id": 34335036670032, "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474", "alt": null, "width": 2000, "height": 2000 }, { "id": 34335036637264, "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_BACK-2000x2000_e77818fa-1038-4cca-8b96-a564cdcf8960.png?v=1751563474", "alt": null, "width": 2000, "height": 2000 }, { "id": 34335036440656, "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_TD-2000x2000_fd13bfa7-dcd1-4dac-a939-9860862c97fc.png?v=1751563474", "alt": null, "width": 2000, "height": 2000 }, { "id": 34335036506192, "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_SOLE-2000x2000_582b853d-df2d-499c-93d2-64bb69938a10.png?v=1751563474", "alt": null, "width": 2000, "height": 2000 }, { "id": 34335036538960, "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_PAIR_3Q-2000x2000_2c410820-4cd1-4c7e-ac65-5d2af3352c7b.png?v=1751563474", "alt": null, "width": 2000, "height": 2000 } ], "publishedAt": "2025-12-02T10:16:17-08:00", "createdAt": "2025-07-03T10:24:31-07:00", "updatedAt": "2025-12-07T01:58:27-08:00", "priceRange": { "min": 94, "max": 94, "currency": "USD" }, "variantsSummary": { "total": 13, "available": 1, "percentAvailable": "7.69%" }, "variants": [ { "id": 41222412238928, "sku": "A11850W050", "title": "Rugged Beige / 5", "size": "5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": true, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412271696, "sku": "A11850W055", "title": "Rugged Beige / 5.5", "size": "5.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412304464, "sku": "A11850W060", "title": "Rugged Beige / 6", "size": "6", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412337232, "sku": "A11850W065", "title": "Rugged Beige / 6.5", "size": "6.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412370000, "sku": "A11850W070", "title": "Rugged Beige / 7", "size": "7", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412402768, "sku": "A11850W075", "title": "Rugged Beige / 7.5", "size": "7.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412435536, "sku": "A11850W080", "title": "Rugged Beige / 8", "size": "8", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412468304, "sku": "A11850W085", "title": "Rugged Beige / 8.5", "size": "8.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412501072, "sku": "A11850W090", "title": "Rugged Beige / 9", "size": "9", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412533840, "sku": "A11850W095", "title": "Rugged Beige / 9.5", "size": "9.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412566608, "sku": "A11850W100", "title": "Rugged Beige / 10", "size": "10", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412599376, "sku": "A11850W105", "title": "Rugged Beige / 10.5", "size": "10.5", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" }, { "id": 41222412632144, "sku": "A11850W110", "title": "Rugged Beige / 11", "size": "11", "color": "Rugged Beige", "price": "94.00", "compareAtPrice": "135.00", "available": false, "inventoryQuantity": "HIDDEN", "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474" } ] } If a store blocks product access: json { "sourceUrl": "https://blocked-store.com", "error": "Shopify API disabled or store not accessible." } --- ## 🧠 Features - ⚡ Zero-browser scraping (API-only) - 📦 Complete catalog extraction - 👟 Smart size detection (men/women/unisex) - 🔄 Correct variant → image pairing - 🚀 Extremely fast & resource-efficient - 🌐 Automatic Apify Proxy rotation - 🛡️ Anti-block retry logic - 📦 Clean, normalized output schema --- ## 💡 Use Cases - Competitor price tracking - Inventory monitoring (in/out-of-stock) - Product trend analysis - Dropshipping research - SEO audits for ecommerce stores - Bulk catalog downloading --- ## ❓ FAQs ### 1. Does this work on all Shopify stores? Yes — it works on any public Shopify store that has not disabled /products.json (almost all stores). ### 2. Can I scrape password-protected stores? No — only public stores are supported. ### 3. How fast is it? Extremely fast. A 5,000 product store can often be scraped in under one minute. ### 4. Why is inventoryQuantity always “HIDDEN”? Shopify stopped exposing exact inventory counts in 2018. However, available: true/false is 100% accurate. ### 5. Do I need to configure a proxy? No — Apify Proxy is used automatically. --- ## 🧑‍💻 Developer Info Author: codescraper Email: codescraper011@gmail.com --- ## 🏷️ Tags shopify · shopify-product-scraper · shopify-scraper · e-commerce · product-scraper fast-shopify-product-scraper · inventory-tracker · price-monitor