IndiaMart Product Details Scraper

This Actor extracts product details from seller pages on IndiaMart using Puppeteer. It's built on Apify's PuppeteerCrawler to handle JavaScript-rendered content and is configured for reliable, parallel crawling.

Overview

The Actor navigates to IndiaMart seller product pages you provide, executes JavaScript to load dynamic content, and extracts structured data into a dataset. It's designed for e-commerce data extraction and uses configurable proxies to manage request rates and avoid blocking.

Key Features

• Puppeteer Crawler: Uses headless Chrome to crawl pages requiring JavaScript execution.
• Configurable Proxy: Integrates with Apify Proxy or custom proxies to rotate IPs and circumvent IP blocking.
• Structured Output: Saves extracted data into an Apify Dataset, with each item having consistent attributes.
• Input Schema: Validates run configuration via a defined input schema.
• Custom Routing: Uses a request handler/router (routes.js) for precise control over different page types.

How to Use

1. Configure Input: Provide the Actor with a list of start URLs pointing to IndiaMart product pages in the INPUT.json.
2. Set Up Proxy (Optional): Configure Actor.createProxyConfiguration() to use Apify Proxy or your own proxy servers for rotation.
3. Run the Crawler: The PuppeteerCrawler is instantiated with your proxy config and a custom requestHandler.
4. Handle Data Extraction: The main logic resides in routes.js. You define handlers (like a 'detail' handler) to parse pages and push data.
   javascript router.addHandler('detail', async ({ request, page, log }) => { // Your extraction logic here const title = await page.title(); await Dataset.pushData({ url: request.loadedUrl, title, // ... other product fields }); });
5. Get Results: Once finished, download the structured data (JSON, CSV, etc.) from the Actor's Dataset.

Input/Output

Input (INPUT.json):
* startUrls: (Array) Required. List of URLs to IndiaMart product/seller pages.

Output (Dataset):
Each item contains fields extracted from the target pages, such as:
* url: The scraped page URL.
* title: Product title.
* (Additional product details like price, description, seller info are extracted based on the custom handler logic in routes.js).

Resources

• Crawlee + Apify Platform guide
• PuppeteerCrawler Documentation and Examples
• Apify SDK Documentation
• How to scale Puppeteer and Playwright