Funnel Sniper

An Apify actor that crawls e-commerce websites to extract funnel structures, calls-to-action (CTAs), pricing, promotions, and product metadata. It's built on Crawlee with Playwright for reliable browser automation.

Key Features

• Multi-Platform Detection: Identifies sites built on Shopify, WooCommerce, Magento, ClickFunnels, Kajabi, Leadpages, SamCart, or generic platforms.
• Configurable Extraction: Toggle specific data types to scrape: funnels, CTAs, pricing, promotions, product details, category pages, and general metadata.
• Structured Output: Returns consistent, detailed JSON records for each crawled page.
• Crawl Control: Limit by request count, crawl depth, and allowed domains.
• Artifact Capture: Optionally save PNG screenshots and full HTML for each page.

How to Use

Input Configuration (actor.json)

Configure the crawl via these key input fields:

• startUrls (array): Initial URLs to seed the crawl (e.g., homepage, category, product pages).
• maxRequestsPerCrawl (int): Hard limit on the number of pages to process.
• maxDepth (int): How many link hops to follow from seed URLs.
• allowedDomains (array): Restrict crawling to specific domains.
• extract (string[]): Enable the data types you need: funnels, ctas, pricing, promotions, product, category, meta.
• proxy (object): Configure proxy settings, e.g., { "useApifyProxy": true }.
• includeScreenshots / includeHtml (boolean): Set to true to store page screenshots and HTML.
• headless (boolean): Run browser in headless mode.

Running the Actor

Locally:

npm install
npm start

On Apify:

apify login
apify push
# Run via the Apify Console or API

Input & Output

Output Schema (Per Page)

The actor outputs a detailed JSON object for each page. Extracted fields depend on the extract input configuration.

{
  "pageUrl": "https://example.com/product-x",
  "pageType": "product|category|other",
  "platform": "shopify|woocommerce|magento|clickfunnels|kajabi|leadpages|samcart|generic",
  "meta": { "title": "...", "description": "...", "canonical": "..." },
  "ctas": [{ "text": "Add to cart", "href": "/cart" }],
  "promotions": ["Sale", "-20%"],
  "pricing": { "prices": ["$49.99"], "saleIndicators": ["Sale"] },
  "product": {
    "title": "...",
    "price": { "value": 49.99, "currency": "$" },
    "sku": "SKU-123",
    "images": ["https://.../img1.jpg"]
  },
  "category": {
    "title": "Category name",
    "products": [{ "title": "P1", "priceText": "$12.99", "href": "/p1" }]
  }
}

Funnel Sequence Records

When funnel detection is enabled, the actor may also emit minimal records outlining a detected multi-step funnel sequence.

{
  "url": "https://example.com",
  "platform": "shopify",
  "steps": [
    {"stepNumber": 1, "type": "landing", "url": "..."},
    {"stepNumber": 2, "type": "checkout", "url": "...", "checkout": {"stepCount": 2}}
  ]
}

Notes

• Use proxy.useApifyProxy=true for robust, production-level crawling.
• The actor respects depth and domain limits. Future updates may include sitemap support.