Site Lens – Website Visual & Technical Analyzer Site Lens is a website snapshot and asset extraction Actor that analyzes any website and exports full-page screenshots, real downloadable assets, and technical insights. It is designed for design audits, website redesigns, SEO analysis, competitive research, and content archiving. --- ## 🚀 What Site Lens Does When you provide a website URL, Site Lens will: ### 📸 Capture Visual Snapshots - Full-page desktop screenshot - Full-page mobile screenshot ### 🖼️ Export Real Downloadable Assets - Download all images used on the website - Extract video & animation sources (HTML5, embeds) ### 📝 Extract Website Content - Full visible text from each page - All internal & external links ### 🎨 Analyze Design & CSS - Fonts (family, weight, style) - Color palette from computed CSS All outputs are stored in a structured way so users can download files directly from the Apify Console or via API. --- ## 📥 Input | Field | Description | |----|----| | url | Website URL to analyze | | maxDepth | Crawl depth (1 = homepage only) | | captureScreenshots | Enable/disable screenshots | | extractImages | Download all images | | extractVideos | Extract video & animation sources | | extractCss | Extract fonts & colors | | proxyConfiguration | Apify proxy settings (datacenter, residential, custom IPs) | --- ## 📤 Output Overview ### 📊 Dataset (Index) The dataset contains one row per analyzed page with: - Page URL - Title - Asset counts - Direct pointers to downloadable files ### 🗂️ Key-Value Store (Assets) | Folder | Content | |------|--------| | screenshots/ | Desktop & mobile screenshots | | images/ | Downloaded image files | | videos/ | Video & animation source URLs | | text/ | Full extracted page text | | css/ | Fonts & color palette | | links/ | All extracted links | All files are directly downloadable from the Output tab. --- ## 🧩 Example Use Cases - 🎨 UI/UX audits & redesign planning - 📦 Website cloning & handoff to designers - 🔍 SEO & content analysis - 🧠 AI training & website dataset generation - 🗄️ Legal or compliance website archiving - 📊 Competitive website analysis --- ## ⚙️ Technology Stack - Crawlee + Playwright - Chromium (headless) - Apify SDK - Supports Apify Proxy (datacenter, residential, custom IPs) --- ## 🏁 Getting Started 1. Enter a website URL 2. Configure optional settings 3. Run the Actor 4. Download screenshots, assets, and data from the Output tab --- ## ⚠️ Notes - Respect websites’ Terms of Service - Do not scrape private or restricted content - Large websites may take longer depending on depth and assets --- ## 👤 Author Built as part of the Apify $1M Challenge to demonstrate a production-grade website analysis and asset extraction tool. --- ## 🔗 Resources - Apify Platform: https://apify.com - Crawlee Docs: https://crawlee.dev - Playwright: https://playwright.dev