SimilarWeb Scraper
by ecomdate
Scrape SimilarWeb website analytics in bulk, including traffic, rankings, categories, top countries, screenshots, tags, and similar sites. Ideal for S...
Opens on Apify.com
About SimilarWeb Scraper
Scrape SimilarWeb website analytics in bulk, including traffic, rankings, categories, top countries, screenshots, tags, and similar sites. Ideal for SEO research, competitor analysis, and lead scoring. Supports pay-per-event pricing and large domain lists.
What does this actor do?
SimilarWeb Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
SimilarWeb Bulk Analytics & Similar Sites Scraper Apify Actor for scraping Similarweb website analytics and similar sites in bulk. Paste a list of domains, choose whether to include similar sites, and get clean, structured data ready for enrichment, lead scoring, and market research. No Similarweb API key required - the actor works on publicly available data and handles concurrency, retries. ------------------------------------------------------------------------ ## What this Actor does For each domain, the Actor can: - π Scrape website overview - title, description, category, traffic & ranks - π Capture traffic & geography - total visits, global rank, category rank, top country & rank - πΌ Grab visual assets - favicon + mobile & desktop screenshots - π§ (Optional) Discover similar sites - related domains with the same rich analytics - π§© (Optional) Tag each site - topic/brand tags extracted from Similarweb You can run it on a few domains for quick checks or thousands of domains for bulk analytics pipelines. ------------------------------------------------------------------------ ## Who is it for? - Growth & SEO teams - competitor analysis, content & keyword research - Sales & RevOps - lead scoring, ICP matching, prioritizing high-traffic domains - Investors & analysts - traffic and category signals for portfolio or prospect research - Data platforms & SaaS - enrichment of existing domain lists with traffic & ranking metrics ------------------------------------------------------------------------ ## Pricing (Pay-Per-Event) This Actor uses Apify Pay-Per-Event (PPE) pricing: - Overview Scraped - $4 per 1,000 events - 1 event per successfully scraped domain overview - Always charged when a domain is successfully processed - Similar Sites Scraped - $4 per 1,000 events - 1 event per domain where similar sites data is successfully scraped - Charged only if scrapeSimilarSites: true and similar sites are fetched successfully ### Quick cost examples | Use case | Example size | Approx. PPE cost | |----------|--------------|-------------------| | Only overviews | 1,000 domains | $4 | | Overview + similar sites | 1,000 domains | $8 | Compute costs not included. Actual costs may vary based on success rates. ## Features - π Async bulk processing - domains processed concurrently for fast runs - π Automatic retry handling - simple transient errors are retried for you - π Optional similar sites lookup - enable only when you need it - π Rich analytics - visits, ranking, categories, geography, tags - πΎ Clean dataset output - one record per domain, optionally with an array of similar sites ------------------------------------------------------------------------ ## Input Parameters ### Actor input | Field | Type | Required | Default | Description | |-------|------|----------|---------|-------------| | domains | Array | Yes | - | List of domains to scrape. | | scrapeSimilarSites | Boolean | No | false | If true, also scrape similar sites. | ### Example input json { "domains": [ "stripe.com", "apple.com" ], "scrapeSimilarSites": true } ------------------------------------------------------------------------ ## Output data The Actor outputs structured data stored in the default Apify dataset. ------------------------------------------------------------------------ ### Example output json { "domain": "stripe.com", "inputDomain": "stripe.com", "title": "Stripe Privacy Center", "description": "Stripe's suite of modular UI building blocks make it easy to design a secure on-brand checkout and payments experience for your customers.", "snapshotDate": "2025-10-01T00:00:00+00:00", "category": "Finance", "globalRank": 458, "topCountry": "US", "topCountryRank": 325, "categoryRank": 26, "totalVisits": 94590134, "bounceRate": 0.5424, "pagesPerVisit": 3.3, "timeOnSite": 175.23, "estimatedMonthlyVisits": { "2025-08-01": 91752638, "2025-09-01": 88593774, "2025-10-01": 94590134 }, "topCountryShares": { "US": 0.3064, "GB": 0.0907, "FR": 0.0521, "IN": 0.0443, "CA": 0.0342 }, "trafficSources": { "Direct": 0.5769, "Referrals": 0.2912, "Search": 0.12, "Social": 0.0065, "Paid Referrals": 0.0045, "Mail": 0.0009 }, "topKeywords": [ { "name": "stripe", "volume": 2765510, "cpc": 2.74, "estimatedMonthlyValue": 2430000 }, { "name": "stripe login", "volume": 199710, "cpc": 3.49, "estimatedMonthlyValue": 199340 } ], "favicon": "https://site-images.similarcdn.com/image?url=stripe.com&t=2&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=4&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=1&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "tags": [], "similarSites": [], "isSmallSite": false, "isDataFromGoogleAnalytics": false, "scrapedAt": "2025-12-03T10:30:45.123Z" } ------------------------------------------------------------------------ ### Additional fields When scrapeSimilarSites is set to true, the output items will include the following additional fields: json { "similarSites": [ { "domain": "americanexpress.com", "title": "American Express Credit Cards, Rewards & Banking", "description": "American Express offers world-class Charge and Credit Cards, Gift Cards, Rewards, Travel, Personal Savings, Business Services, Insurance and more.", "totalVisits": 101459089, "globalRank": 313, "categoryRank": 6, "topCountry": "US", "topCountryRank": 98, "favicon": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=2&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=4&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=1&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3" }, { "domain": "cigna.com", "title": "Cigna Healthcare | Health Insurance, Dental Plans & Medicare", "description": "Cigna Healthcare offers health insurance plans such as medical and dental to individuals and employers, international health insurance, and Medicare coverage.", "totalVisits": 11020147, "globalRank": 3749, "categoryRank": 16, "topCountry": "US", "topCountryRank": 767, "favicon": "https://site-images.similarcdn.com/image?url=cigna.com&t=2&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=4&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=1&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9" } ], "tags": [ "stripe", "online payments", "payments" ] } ------------------------------------------------------------------------ ### Main item fields | Field | Type | Description | |-------|------|-------------| | domain | String | Normalized domain name | | inputDomain | String | Original input URL/domain | | title | String | Website title | | description | String | Website description | | snapshotDate | String (ISO date) | Data snapshot date | | category | String | Website category path | | globalRank | Integer | Global traffic rank | | categoryRank | Integer | Category rank | | topCountry | String | Top traffic country code | | topCountryRank | Integer | Rank in that top country | | totalVisits | Integer | Total visits | | bounceRate | Number | Bounce rate (0-1) | | pagesPerVisit | Number | Average pages per visit | | timeOnSite | Number | Average time on site (seconds) | | estimatedMonthlyVisits | Object | Monthly visits history (date β visits) | | topCountryShares | Object | Top country traffic shares (countryCode β share) | | trafficSources | Object | Traffic source breakdown (source β share) | | topKeywords | Array
scrapeSimilarSites | Boolean | No | false | If true, also scrape similar sites. | ### Example input json { "domains": [ "stripe.com", "apple.com" ], "scrapeSimilarSites": true } ------------------------------------------------------------------------ ## Output data The Actor outputs structured data stored in the default Apify dataset. ------------------------------------------------------------------------ ### Example output json { "domain": "stripe.com", "inputDomain": "stripe.com", "title": "Stripe Privacy Center", "description": "Stripe's suite of modular UI building blocks make it easy to design a secure on-brand checkout and payments experience for your customers.", "snapshotDate": "2025-10-01T00:00:00+00:00", "category": "Finance", "globalRank": 458, "topCountry": "US", "topCountryRank": 325, "categoryRank": 26, "totalVisits": 94590134, "bounceRate": 0.5424, "pagesPerVisit": 3.3, "timeOnSite": 175.23, "estimatedMonthlyVisits": { "2025-08-01": 91752638, "2025-09-01": 88593774, "2025-10-01": 94590134 }, "topCountryShares": { "US": 0.3064, "GB": 0.0907, "FR": 0.0521, "IN": 0.0443, "CA": 0.0342 }, "trafficSources": { "Direct": 0.5769, "Referrals": 0.2912, "Search": 0.12, "Social": 0.0065, "Paid Referrals": 0.0045, "Mail": 0.0009 }, "topKeywords": [ { "name": "stripe", "volume": 2765510, "cpc": 2.74, "estimatedMonthlyValue": 2430000 }, { "name": "stripe login", "volume": 199710, "cpc": 3.49, "estimatedMonthlyValue": 199340 } ], "favicon": "https://site-images.similarcdn.com/image?url=stripe.com&t=2&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=4&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=1&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "tags": [], "similarSites": [], "isSmallSite": false, "isDataFromGoogleAnalytics": false, "scrapedAt": "2025-12-03T10:30:45.123Z" } ------------------------------------------------------------------------ ### Additional fields When scrapeSimilarSites is set to true, the output items will include the following additional fields: json { "similarSites": [ { "domain": "americanexpress.com", "title": "American Express Credit Cards, Rewards & Banking", "description": "American Express offers world-class Charge and Credit Cards, Gift Cards, Rewards, Travel, Personal Savings, Business Services, Insurance and more.", "totalVisits": 101459089, "globalRank": 313, "categoryRank": 6, "topCountry": "US", "topCountryRank": 98, "favicon": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=2&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=4&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=1&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3" }, { "domain": "cigna.com", "title": "Cigna Healthcare | Health Insurance, Dental Plans & Medicare", "description": "Cigna Healthcare offers health insurance plans such as medical and dental to individuals and employers, international health insurance, and Medicare coverage.", "totalVisits": 11020147, "globalRank": 3749, "categoryRank": 16, "topCountry": "US", "topCountryRank": 767, "favicon": "https://site-images.similarcdn.com/image?url=cigna.com&t=2&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=4&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=1&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9" } ], "tags": [ "stripe", "online payments", "payments" ] } ------------------------------------------------------------------------ ### Main item fields | Field | Type | Description | |-------|------|-------------| | domain | String | Normalized domain name | | inputDomain | String | Original input URL/domain | | title | String | Website title | | description | String | Website description | | snapshotDate | String (ISO date) | Data snapshot date | | category | String | Website category path | | globalRank | Integer | Global traffic rank | | categoryRank | Integer | Category rank | | topCountry | String | Top traffic country code | | topCountryRank | Integer | Rank in that top country | | totalVisits | Integer | Total visits | | bounceRate | Number | Bounce rate (0-1) | | pagesPerVisit | Number | Average pages per visit | | timeOnSite | Number | Average time on site (seconds) | | estimatedMonthlyVisits | Object | Monthly visits history (date β visits) | | topCountryShares | Object | Top country traffic shares (countryCode β share) | | trafficSources | Object | Traffic source breakdown (source β share) | | topKeywords | ArrayCategories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try SimilarWeb Scraper now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- ecomdate
- Pricing
- Paid
- Total Runs
- 126
- Active Users
- 16
Related Actors
Google Search Results Scraper
by apify
Google Search Results (SERP) Scraper
by scraperlink
Google Search
by devisty
Bing Search Scraper
by tri_angle
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support