📊 Social Media Insights Scraper ## 🚀 Overview The Social Media Insights Scraper is an Apify Actor that collects and processes data from the most popular social media platforms: • 🎥 YouTube – Extracts metadata, likes, comments, and engagement from video posts. • 📸 Instagram – Gathers insights from posts, reels, and stories, including user information and engagement data. • 🎵 TikTok – Extract title, description and engagement data This Actor helps marketers, researchers, and data analysts extract actionable insights to track social media performance and analyze trends at scale. ⸻ 📥 Input Configuration To configure the Actor, provide a JSON object in the INPUT field with the following structure: { "url": "https://www.instagram.com/p/C4ixfyPOwvP/", "publishedDate": "2025-03-28T14:49:45.182Z" } 🎛️ Input Parameters | Parameter | Type | Description | Required | |-----------|------|-------------|----------| | url | string | URL of the post or video to scrape (Instagram, YouTube, or TikTok). | ✅ Yes | | publishedDate | string | (Optional) ISO date-time string to filter posts published after a certain date. | ❗ No | ⸻ 📤 Output Format The results are stored in the Apify Dataset in a structured format. Below is mock data to demonstrate the output: json [ { "url": "https://www.instagram.com/p/C4ixfyPOwvP/", "data": { "url": "https://www.instagram.com/p/C4ixfyPOwvP/", "type": "post", "referenceId": "C4ixfyPOwvP", "platform": "instagram", "result": { "type": "engagement", "likes": 2500, "comments": 180, "engagements": 2680, "screenName": "Samsung Middle East", "username": "@samsung_me", "title": "Samsung Galaxy S24 Launch", "description": "Experience the future of smartphones with the Samsung Galaxy S24, now available with special offers.", "publishedDate": "2025-03-28T14:49:45.182Z" } } }, { "url": "https://www.youtube.com/watch?v=dQw4w9WgXcQ", "data": { "url": "https://www.youtube.com/watch?v=dQw4w9WgXcQ", "type": "video", "referenceId": "dQw4w9WgXcQ", "platform": "youtube", "result": { "type": "engagement", "likes": 3400000, "comments": 215000, "engagements": 3615000, "screenName": "Rick Astley", "username": "@rickastleyofficial", "title": "Never Gonna Give You Up", "description": "The official video for Never Gonna Give You Up by Rick Astley.", "publishedDate": "2009-10-25T18:30:00.000Z" } } }, { "url": "https://www.tiktok.com/@charlidamelio/video/1234567890", "data": { "url": "https://www.tiktok.com/@charlidamelio/video/1234567890", "type": "video", "referenceId": "1234567890", "platform": "tiktok", "result": { "type": "engagement", "likes": 1200000, "comments": 89000, "engagements": 1289000, "screenName": "Charli D'Amelio", "username": "@charlidamelio", "title": "Dance Challenge", "description": "Charli D'Amelio takes part in the latest TikTok dance challenge.", "publishedDate": "2025-03-20T10:30:00.000Z" } } } ] ⸻ 📊 Output Fields | Field | Type | Description | |-------|------|-------------| | url | string | The URL of the post or video being scraped. | | data.url | string | URL of the post or video. | | data.type | string | Type of content (post, reel, video). | | data.referenceId | string | Unique ID of the post or video. | | data.platform | string | Platform name (instagram, youtube, tiktok). | | data.result.type | string | Type of result (engagement). | | data.result.likes | integer | Number of likes. | | data.result.comments | integer | Number of comments. | | data.result.engagements | integer | Total number of engagements. | | data.result.screenName | string | Screen name of the account. | | data.result.username | string | Username of the account. | | data.result.title | string | Title of the post or video. | | data.result.description | string | Full description or caption. | | data.result.publishedDate | string | ISO date-time string when the post was published. | ⸻ 📝 How to Run 1. Run in Apify Console • Go to Apify Console. • Create a new task for the Social Media Insights Scraper. • Provide the required input JSON. • Run the task and monitor progress. ⸻ 📚 Use Cases 📊 Competitor Analysis Track how your competitors are performing across multiple platforms by analyzing their engagement metrics. 📈 Trend Analysis Identify trends by monitoring high-engagement content and popular hashtags. 🔎 Influencer Marketing Evaluate the performance of influencer partnerships by assessing audience interaction and post reach. 📝 Content Strategy Refine your content strategy by understanding what types of content generate the most engagement. ⸻ ⚙️ Technical Details • Written in Node.js using the Apify SDK. • Supports CheerioCrawler and PuppeteerCrawler for scraping. • Handles rate limiting and retries to avoid platform bans. • Automatically switches between API scraping and HTML parsing based on availability. ⸻ 🛠️ Limitations & Rate Limits • Scraping Instagram and TikTok may be subject to IP bans or request limits. • Ensure compliance with each platform’s Terms of Service. • For high-scale scraping, consider using Proxies and rotating IPs. ⸻ 📝 Changelog v1.0.0 (Initial Release) • Added support for scraping YouTube, Instagram, and TikTok. • Included engagement metrics and metadata. ⸻ 🧩 Support and Feedback If you encounter any issues, or have feature requests, please: • 🐛 Report an issue