Amazon Product Scraper

An Apify actor that scrapes structured product data from Amazon based on a search term. It's designed for e-commerce automation, market research, and building product databases.

Overview

This actor automates the extraction of product listings from Amazon. You provide a search query, and it returns a dataset of products with details like price, ratings, images, and availability. It handles browser automation, proxy rotation, and data structuring.

Common use cases include generating product catalogs, building price comparison databases, conducting market research by category, and performing competitive analysis.

Key Features

• Structured Data Extraction: Pulls key product fields into a consistent JSON format.
• Configurable Search: Scrape products for any search term (e.g., "laptops", "blenders").
• Built-in Proxy Management: Uses Apify Proxy by default to avoid IP blocks and ensure reliable, large-scale scraping.
• Concurrency Control: Adjust the number of parallel requests (maxConcurrency) for performance tuning.
• Headless Operation: Runs in headless mode by default for efficiency.

Input Configuration

Configure the actor using these input fields. Only the search term is required.

{
  "search": "wireless headphones",
  "maxItems": 50,
  "maxConcurrency": 2,
  "headless": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
  }
}

• search (string): Your Amazon search query.
• maxItems (number): Maximum number of products to scrape.
• maxConcurrency (number): Maximum concurrent browser pages/requests.
• headless (boolean): Run browser without a GUI (true by default).
• proxyConfiguration: Uses Apify Proxy with residential IPs. The apifyProxyCountry can be changed.

Output

The actor outputs a dataset where each item is a structured product object.

Core Fields Include:
* productId: The Amazon ASIN.
* title, brand, description, category
* price, currency, mrp, listPrice
* rating, ratingCount
* url, image, images[]
* availability, primeEligible, freeDelivery
* sponsored, amazonChoice
* variations[]: Array of available variants (color, size, etc.).

Sample Output Snippet:

{
  "productId": "B08N5WRWNW",
  "title": "Samsung Galaxy F54",
  "brand": "Samsung",
  "price": 24999,
  "currency": "USD",
  "rating": 4.4,
  "ratingCount": 18231,
  "url": "https://www.amazon.com/...",
  "availability": "In Stock"
}

How to Use

1. Open the actor in the Apify Console.
2. Click "Try actor" or create a new task.
3. In the Input tab, enter your configuration (e.g., {"search": "mobiles"}).
4. Click "Start" to run the actor.
5. Once finished, download your data from the Dataset tab in formats like JSON, CSV, or Excel.

Tech Stack

• Apify SDK – For actor lifecycle and data management.
• Crawlee – For robust crawling and scraping logic.
• Puppeteer – For browser automation and rendering JavaScript-heavy pages.
• Node.js – Runtime environment.