⚙️ [Fast & Low Cost] BuiltWith Bulk Technology Profile Scraper --- Scrape technology stacks from any list of websites using BuiltWith — fast and at scale. Just provide a list of URLs. Perfect for marketers, developers, analysts, or sales teams looking to analyze web tech usage. --- ## 🧠 What It Does This scraper collects structured technology stack data from BuiltWith profiles and outputs a clean, exportable dataset in CSV or JSON format — ready for enrichment, targeting, or analytics. --- ## 🔧 Inputs - URL List (required): Provide a list of website URLs (e.g., stripe.com, zoom.us). The scraper will query BuiltWith for each. > ⚙️ Note: You can optionally use a proxy (custom or Apify's) to rotate IPs and avoid blocks from BuiltWith. --- ## 🛠️ How to use Just input all URLs manually or through a JSON file and get your data! --- ## 📤 Output Format You’ll get structured technology profile data like this (CSV or JSON): json { "domain": "chatgpt.com", "Analytics and Tracking": [ "Statsig" ], "Widgets": [ "Cloudflare Bot Manager", "CrUX Dataset", "CrUX Top 1000", "CrUX Top 500k", "Cloudflare Radar", "Cloudflare Radar Top 50k", "Cloudflare Turnstile", "Smart App Banner" ], "Frameworks": [ "Next.js", "Remix", "Java EE" ], "Mobile": [ "Viewport Meta", "IPhone / Mobile Compatible", "Apple Mobile Web Clips Icon" ], "Content Delivery Network": [ "jsDelivr", "Cloudflare", "Cloudflare Challenge", "Cloudflare Automatic Challenge", "Content Delivery Network" ], "Payment": [ "Stripe" ], "JavaScript Libraries and Functions": [ "jQuery", "Intersection Observer", "core-js", "React", "HTML5 History API" ], "Verified Link": [ "GitHub", "YouTube Link", "Artificial Intelligence" ], "Name Server": [ "3 to 9 ccTLD Redirects", "Cloudflare DNS" ], "Email Hosting Providers": [ "Dmarcian", "SPF", "DMARC", "DMARC Reject" ], "SSL Certificates": [ "LetsEncrypt", "SSL by Default", "HSTS", "HSTS IncludeSubdomains PreLoad" ], "Web Hosting Providers": [ "Cloudflare Hosting", "403 Error" ], "Operating Systems and Servers": [ "IPv6" ], "Web Servers": [ "Microsoft Personal Web Server" ], "Verified CDN": [ "Cloudflare CDN" ], "Robots.txt": [ "Some Robots Disallow", "Anthropic Claude Bot Disallow", "ByteDance Bytespider Disallow", "Common Crawl Bot Disallow", "Facebook Bot Disallow", "Google Bard Disallow", "Webz Omgili Disallow" ], "Web Master Registration": [ "Google Webmaster" ] } --- ## 🎯 Common Use Cases - 🔍 Analyze the tech stack of competitor or prospect websites - 📊 Export clean data for market research and business intelligence - 🧲 Build contact lists based on technology usage (e.g., Shopify users) - ⚡ Runs fast, handles large URL lists efficiently - 🔌 Seamless integration with Apify for scheduling, proxies, datasets and webhooks --- ## 🧑‍🤝‍🧑 The team - 🐐 Developed and maintained by the ScrapeGoats. - 💬 Reach out on Discord if you're interested in custom scrapers or want to suggest new use cases.