Scrapy Actor – Social Media Link Extractor This actor crawls a list of input URLs and extracts social media links (e.g. Facebook, Twitter/X, Instagram, LinkedIn, YouTube, TikTok, etc.) that exist on those pages. --- ## 🚀 How it works 1. You provide a list of URLs as input. 2. The actor visits each URL and scrapes all <a> tags. 3. It filters out links that match known social media domains. 4. Results are stored in the Apify dataset in the following structure: json { "Input Url": "https://www.example.com/", "Facebook": [ "https://www.facebook.com/example/" ], "Twitter/X": [], "Instagram": [ "https://www.instagram.com/example/" ], "LinkedIn": [ "https://www.linkedin.com/in/example1/", "https://www.linkedin.com/in/example2/" ], "TikTok": [], "YouTube": [], "Pinterest": [], "Reddit": [], "Snapchat": [], "Tumblr": [], "Threads": [], "Discord": [], "Twitch": [], "WhatsApp": [], "Raw Text": "Text Data" } --- ## 📥 Input The actor expects a JSON input with an array of URLs: json { "startUrls": [ { "url": "https://example.com" }, { "url": "https://another.com" } ] } --- ## 📤 Output The dataset will contain one item per input URL, with each social platform as its own column. | Input URL | Facebook | Instagram | LinkedIn | Twitter/X | YouTube | TikTok | Pinterest | Reddit | Snapchat | Tumblr | Threads | Discord | Twitch | WhatsApp | Raw Text | |---------------------|-----------------------------------|----------------------------------|--------------------------------------|-----------|---------|--------|-----------|--------|----------|--------|---------|---------|--------|----------|------------------------------------| | https://example.com | https://facebook.com/example | https://instagram.com/example | | | | | | | | | | | | | Full scraped text from the page... | | https://another.com | | | https://linkedin.com/company/test | | | | | | | | | | | | Full scraped text from the page... | ### Fields: 1. Input URL – the page where links were found 2. Facebook – extracted Facebook links (array) 3. Instagram – extracted Instagram link (array) 4. LinkedIn – extracted LinkedIn link (array) 5. Twitter/X – extracted Twitter/X link (array) 6. YouTube – extracted YouTube link (array) 7. TikTok – extracted TikTok link (array) 8. Pinterest – extracted Pinterest link (array) 9. Reddit – extracted Reddit link (array) 10. Snapchat – extracted Snapchat link (array) 11. Tumblr – extracted Tumblr link (array) 12. Threads – extracted Threads link (array) 13. Discord – extracted Discord link (array) 14. Twitch – extracted Twitch link (array) 15. WhatsApp – extracted WhatsApp link (array) 16. Raw Text – all text found on page --- ## 🌐 Running on Apify 1. Go to the actor’s page on Apify. 2. Click Try actor and provide the input JSON (see Input section). 3. Run the actor. 4. View results in the Dataset tab (exportable as JSON, CSV, or Excel). --- ## 📚 Example social domains handled - Facebook → facebook.com, fb.com - Instagram → instagram.com, instagr.am - Twitter/X → twitter.com, x.com - LinkedIn → linkedin.com - YouTube → youtube.com, youtu.be - TikTok → tiktok.com - Pinterest → pinterest.com - Reddit → reddit.com, redd.it - Snapchat → snapchat.com, sc.com - Tumblr → tumblr.com - Threads → threads.net - Discord → discord.com, discord.gg - Twitch → twitch.tv - WhatsApp → wa.me, whatsapp.com --- ## 📝 Notes - Some websites hide social links inside menus, scripts, or dynamic sections. This scraper only extracts static <a> tag links.