Simple Contact Info and Social Media Scraper This Apify actor is designed to crawl web pages and extract social media handles, emails, and phone numbers using Puppeteer. It can handle dynamic content and navigate through multiple pages, making it suitable for comprehensive data extraction tasks. If you're looking for examples or want to learn more visit: - Crawlee + Apify Platform guide - Examples ## Included features - Data Extraction: Extracts social media handles, emails, and phone numbers. - Dynamic Content Handling: Supports crawling through links and HTML frames. - Configurable: Set depth and request limits. - Proxy Support: Uses Apify's proxy configuration for anonymity and IP rotation. ## How it works 1. Input: Define start URLs in INPUT.json. 2. Proxy Configuration: Set up proxies to avoid IP blocking. 3. Crawler Setup: Use PuppeteerCrawler with custom routing. 4. Request Handling: Customize page handling in routes.js. 5. Execution: Start the crawler with crawler.run(startUrls);. ## Input Configuration { "considerChildFrames": true, "maxDepth": 2, "maxRequests": 100, "sameDomain": true, "startUrls": [ { "url": "https://nonos.ph/", "method": "GET" } ] } - startUrls: List of URLs to start crawling from. - proxyConfig: Configuration for using Apify's proxy services. - sameDomain: Restrict crawling to the same domain. - maxDepth: Maximum depth of links to follow. - considerChildFrames: Enable crawling of HTML frames. - maxRequests: Total number of requests to make. - maxRequestsPerStartUrl: Limit requests per start URL. ## Output Dataset [ { "depth": 0, "referrerUrl": null, "url": "https://cafelunanewyork.com/", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751", "6468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=craft_beer", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=vegetarian_dishes", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=freshly_baked_daily", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=great_pastries", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=local_ingredients", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=great_sandwiches", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=great_burgers", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=comfort_food", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=gluten_free_dishes", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=organic", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=vegan_dishes", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/-food-menu?source=header&spot_id=93121&destination=food_menu&promotion=family_owned", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/new-york-cafe-luna-food-menu", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/accessibility-page-01", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/#content", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751", "6468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 1, "url": "https://cafelunanewyork.com/new-york-cafe-luna-drink-menu", "domain": "cafelunanewyork.com", "emails": [ "info@cafelunany.com" ], "phones": [ "16468611751" ], "linkedIns": [], "twitters": [], "instagrams": [ "https://www.instagram.com/cafelunanyc" ], "facebooks": [ "https://www.facebook.com/102391985277345" ], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/61570", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/86157", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/86145", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/61568", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/86144", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/582559", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/61565", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/61566", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] }, { "depth": 2, "url": "https://cafelunanewyork.com/113622", "domain": "cafelunanewyork.com", "emails": [], "phones": [], "linkedIns": [], "twitters": [], "instagrams": [], "facebooks": [], "youtubes": [], "tiktoks": [], "pinterests": [], "discords": [] } ] The actor stores its results in the default dataset associated with the actor run. You can download the results in formats such as JSON, HTML, CSV, XML, or Excel. Each record in the dataset includes: - URL: The page URL. - Email: Extracted email addresses. - Phone Number: Extracted phone numbers. - Social Media Profiles: Links to social media profiles (e.g., Facebook, Twitter, LinkedIn). ## Resources If you're looking for examples or want to learn more visit: - Crawlee + Apify Platform guide - Documentation and examples - Node.js tutorials in Academy - How to scale Puppeteer and Playwright - Video guide on getting data using Apify API - Integration with Make, GitHub, Zapier, Google Drive, and other apps ## Documentation reference To learn more about Apify and Actors, take a look at the following resources: - Apify SDK for JavaScript documentation - Apify SDK for Python documentation - Apify Platform documentation - Join our developer community on Discord