Website Email Extractor - Most efficieent ## 🔍 Overview Media Link Extractor is a powerful Apify actor that automatically crawls websites to discover and extract various types of media links including videos, images, audio files, APK files, and email addresses. Perfect for content aggregation, SEO research, lead generation, and digital asset management. ## ✨ Key Features - Multi-Media Support: Extract various media types (videos, images, audio, APKs, emails) - Configurable Crawling: Set crawl depth, concurrency, and URL limits to suit your needs - Smart Extraction: Uses multiple detection methods including URL patterns, HTML tags, and CSS selectors - Proxy Support: Optional Apify proxy integration for better scraping success rates - Domain Filtering: Stays on the same domain to focus crawling on relevant content - Detailed Output: Organized dataset with source URLs, timestamps, and media metadata - Rate Limiting Protection: Built-in mechanisms to avoid overloading target websites ## 🎯 Use Cases - Content Creators: Find media resources for projects and presentations - Digital Marketers: Discover image and video assets for competitor analysis - App Developers: Locate APK distribution points for competitive research - Lead Generation: Extract email addresses for business outreach campaigns - SEO Specialists: Analyze media usage patterns across websites - Researchers: Gather media files for analysis and archiving projects ## 🛠️ Input Parameters json { "startUrls": [{ "url": "https://example.com" }], "mediaType": "all", "maxCrawlDepth": 1, "maxConcurrency": 10, "maxRequestRetries": 3, "maxUrlsToCrawl": 100, "useProxy": { "useApifyProxy": false, "apifyProxyGroups": [], "apifyProxyCountry": "" } } ### Parameter Details | Parameter | Type | Description | | ------------------- | ------ | ----------------------------------------------------------------------------- | | startUrls | Array | List of URLs where the crawler will begin | | mediaType | String | Type of media to extract: video, audio, image, apk, email, or all | | maxCrawlDepth | Number | How many links deep the crawler will go | | maxConcurrency | Number | Maximum parallel requests | | maxRequestRetries | Number | Number of retry attempts for failed requests | | maxUrlsToCrawl | Number | Maximum number of URLs to process | | useProxy | Object | Configuration for Apify proxy usage | ## 📊 Output Format The actor stores results in the default dataset with this structure: json { "sourceUrl": "https://example.com/page", "pageTitle": "Example Page Title", "mediaLinks": [ { "url": "https://example.com/video.mp4", "sourceUrl": "https://example.com/page", "title": "Example Page Title", "type": "video", "foundAt": "2025-04-10T06:40:01.000Z" } ], "timestamp": "2025-04-10T06:40:01.000Z" } ## ⚙️ Technical Implementation Media Link Extractor uses a combination of techniques to find media resources: 1. CSS Selectors: Targets specific HTML elements containing media 2. URL Pattern Matching: Identifies file extensions and URL patterns 3. Context Analysis: Examines surrounding elements for media indicators 4. Domain Adherence: Maintains focus on the original domain ## 💡 Best Practices - Start Small: Begin with a low maxUrlsToCrawl value to test results - Respect Websites: Use reasonable maxConcurrency values to avoid overloading sites - Optimize Depth: Most valuable media is often found within 1-2 levels of crawl depth - Target Specific Media: Use the appropriate mediaType parameter instead of "all" for more focused results ## 📚 Examples ### Extract Videos from a Website json { "startUrls": [{ "url": "https://example.com/videos" }], "mediaType": "video", "maxCrawlDepth": 2, "maxUrlsToCrawl": 50 } ### Find Email Addresses for Lead Generation json { "startUrls": [{ "url": "https://company.com/about" }], "mediaType": "email", "maxCrawlDepth": 3, "maxUrlsToCrawl": 200 } ### Collect APK Files from Android Sites json { "startUrls": [{ "url": "https://apksite.com" }], "mediaType": "apk", "maxCrawlDepth": 2, "maxUrlsToCrawl": 100 } ## 📈 Performance Considerations - Processing speed depends on website complexity and response times - Typical extraction rates: 5-10 pages per second without proxy, 2-5 pages per second with proxy - Memory usage scales with concurrency and page complexity - Consider using Apify proxy for rate-limited or IP-blocking websites ## 🔗 Integration Ideas - Connect with Apify Storage for permanent dataset archiving - Combine with Google Sheets integration for easy team collaboration - Use with Zapier or Make to automate workflows with extracted media - Export data to S3 or other cloud storage for batch processing