Meta Threads Scraper - Posts, Search & Profiles 🚀 Extract complete Threads data including posts, profiles, engagement metrics (likes, comments, reposts, shares), and contact information from bio. Search by keyword, hashtag, or username. Perfect for social media monitoring, influencer outreach, and competitor analysis. No login required. Export to JSON/CSV/Excel. > ⚠️ Experimental Actor: This is an experimental tool. Website structure may change occasionally, which could affect data extraction. Please test with small batches before large-scale use. If you encounter any issues, please report them via the Issues section. Thank you! ## ⚠️ Important: Data Scraping Limitations Threads data scraping has the following inherent limitations: - Data Volume Limits: Threads platform restricts the amount of accessible data. Actual results vary based on account activity, content type, and other factors - Dynamic Loading: Threads uses infinite scroll to load content but stops loading after a certain amount - Text Truncation: Longer post content may be truncated in the feed, requiring additional processing for complete text - Rate Limiting: Too frequent requests may trigger platform protection mechanisms - Content Availability: Private accounts, deleted content, or region-restricted content cannot be accessed ### 🚀 Best Practices 1. Small Batch Testing: Start with smaller limits for initial testing and gradually increase to find optimal settings 2. Realistic Expectations: Understand that actual results may be less than requested 3. Error Handling: Be prepared to handle partial failures or incomplete results 4. Execution Intervals: Avoid too frequent scraping; recommend at least 5-10 minute intervals 5. Data Validation: Always validate scraped data for completeness and accuracy 6. Backup Plans: For critical data, consider multiple scraping attempts or different parameters ## 🌟 Key Features - ✅ Two Scraping Modes: User posts with full profile data & Keyword search - ✅ Three Search Filters: Popular (trending), Recent (latest), Profiles (user discovery) - ✅ Complete Profile Data: Bio, follower counts, verification status - ✅ Contact Information: Auto-extracts emails, phone numbers, and links from bio - ✅ Engagement Metrics: Likes, comments, reposts, and shares for each post - ✅ Rich Post Content: Text, mentions, hashtags, media URLs (auto-translate chips are stripped out) - ✅ No Login Required: Public data only - ✅ Export Formats: JSON, CSV, Excel - ✅ Fast & Reliable: Optimized for performance > ℹ️ Consistent Output: The scraper always launches Chrome with the en-US locale and UTC timezone so that Threads does not inject localized UI text (for example, "Translate" chips) into the captured content. ## 📊 What Data Can You Get? ### User Profile Information - Username and display name - Bio/description (complete text) - Profile picture URL - Follower count (accurate numbers) - Verification status - Profile URL - Contact information: Emails, phone numbers, and website links extracted from bio - External profile links ### Post Content - Text content (may be truncated for long posts) - Post creation time - Post URL and unique code - Engagement metrics: Likes, comments, reposts, and shares - Media attachments (images/videos) - Hashtags used - User mentions (@username.xxx format) - External links > 💡 Pro Tip: Use the "All fields" view in Apify to see all extracted data fields. For long posts that get truncated, you can use the post URL with an HTTP request tool for complete content. ## 🎯 Use Cases - Social Media Monitoring: Track brand mentions and conversations - Influencer Discovery: Find content creators with follower metrics - Competitor Research: Monitor competitor activities and engagement - Content Analysis: Analyze trending topics and hashtags - Lead Generation: Discover profiles in your niche - Market Research: Understand audience sentiment ## 🚀 How to Use ### ⚠️ Important: Correct Input Format Please use the exact field names as shown below to avoid errors: #### ❌ Common Mistakes to Avoid: - Don't use action → use mode instead - Don't use query → use keyword instead - Don't use usernames array → use single username string - Don't include @ symbol in username - Don't use limit → use max_posts instead - Don't use searchFilter → use search_filter instead #### ✅ Correct Input Examples: Scraping User Posts: json { "mode": "user", "username": "zuck", "max_posts": 30 } Searching by Keyword: json { "mode": "keyword", "keyword": "artificial intelligence", "search_filter": "recent", "max_posts": 20 } ### Input Configuration The actor accepts the following input parameters: | Parameter | Type | Description | Example | |-----------|------|-------------|---------| | mode | String | Scraping mode: user or keyword | "user" | | username | String | Target username (for user mode, without @) | "nike" | | keyword | String | Search keyword (for keyword mode) | "AI automation" | | search_filter | String | Search filter: default, recent, or profiles (keyword mode only) | "recent" | | max_posts | Number | Maximum posts to scrape (20-100) | 30 | ### Mode 1: Scrape User Posts (with Profile Data) Extract posts AND complete profile information from a specific user: json { "mode": "user", "username": "zuck", "max_posts": 50 } This returns: - User's bio and follower count - Contact information extracted from bio (emails, phones, links) - All recent posts with engagement metrics (likes, comments, reposts, shares) - Profile verification status - Media attachments - Mentions and hashtags ### Mode 2: Search Posts by Keyword Search for posts or profiles containing specific keywords: #### Popular/Trending Posts (Default) json { "mode": "keyword", "keyword": "artificial intelligence", "search_filter": "default", "max_posts": 30 } #### Recent Posts json { "mode": "keyword", "keyword": "#AI", "search_filter": "recent", "max_posts": 30 } #### Discover User Profiles json { "mode": "keyword", "keyword": "tech entrepreneur", "search_filter": "profiles", "max_posts": 20 } ## 📤 Output Format ### Viewing Your Data 1. Dataset View: Click "Preview" to see extracted posts 2. All Fields: Switch to "All fields" view to see complete data including: - Full user profile information - Complete mention arrays - Media metadata - Additional extracted fields ### Dataset Output Example Each post is saved as a separate record: json { "username": "user123", "display_name": "John Doe", "post_url": "https://www.threads.com/@user123/post/C123456", "post_code": "C123456", "text_content": "This is my post about AI...", "created_at": "2024-01-15T10:30:00+00:00", "like_count": 152, "comment_count": 23, "repost_count": 8, "share_count": 5, "has_media": true, "media_items": [ { "media_type": "image", "media_url": "https://..." } ], "hashtags": ["AI", "Technology"], "mentions": [ { "username": "techfriend", "profile_url": "https://www.threads.com/@techfriend" }, { "username": "ai.researcher", "profile_url": "https://www.threads.com/@ai.researcher" } ], "urls": ["https://example.com/blog-post"], "is_verified": true, "followers_count": 5043, "bio": "Tech enthusiast | AI researcher | Building the future 📧 contact@example.com", "profile_pic_url": "https://...", "profile_url": "https://www.threads.com/@user123", "external_links": ["https://johndoe.com"], "emails": ["contact@example.com"], "phones": [], "bio_links": ["https://johndoe.com"] } ### Working with Long Posts ⚠️ Note on Long Content: Posts with extensive text may be truncated in the scraper output. To get complete content: 1. Use the extracted post_url 2. Make an HTTP request to fetch the full page 3. Parse the complete content from the response Example using the post URL: https://www.threads.com/@username/post/C123456 ## 🔧 Advanced Features ### Search Tips - Use # for hashtag searches (e.g., #AI) - Usernames with dots are fully supported (e.g., @user.name) - Multi-language support (English, Chinese, Japanese, Spanish, etc.) - Combine keywords with spaces for broader results ### Data Quality Features - Accurate follower count parsing (handles K, M, 萬 notations) - Engagement metrics extraction (likes, comments, reposts, shares) - Contact information extraction from bio text (emails, phones, website links) - Clean text extraction (removes timestamps, UI elements, and translation chips) - Complete mention extraction (preserves full username format) - Bio text cleaning (removes follower count artifacts and UI text) ## 💡 Example Use Cases ### 1. Influencer Discovery with Contact Information json { "mode": "keyword", "keyword": "fitness coach", "search_filter": "profiles", "max_posts": 30 } Get profiles with follower counts, contact information (emails, phones, links), and bio data to identify and reach out to influencers. ### 2. Competitor Analysis with Engagement Metrics json { "mode": "user", "username": "competitor_brand", "max_posts": 50 } Extract complete profile data, all recent posts with engagement metrics (likes, comments, reposts, shares) to analyze competitor performance. ### 3. Hashtag Monitoring json { "mode": "keyword", "keyword": "#YourBrand", "search_filter": "recent", "max_posts": 50 } Track real-time mentions and conversations with engagement data. ### 4. Content Research json { "mode": "keyword", "keyword": "AI tools", "search_filter": "default", "max_posts": 30 } Find trending content in your niche with engagement metrics to understand what performs well. ## 📈 Performance & Limits Post Limits: - User posts: Only recent posts accessible, quantity varies by account - Keyword search: Limited by Threads' search results - Profile search: Limited by search results > Note: Threads dynamically loads content and may limit the amount of data available through scrolling. Actual results may be less than the requested limit. ## ❓ Frequently Asked Questions Q: What engagement metrics can I get? A: The scraper extracts likes, comments, reposts, and shares for each post to help you analyze content performance. Q: How does contact information extraction work? A: The scraper automatically extracts emails, phone numbers, and website links from user bio text using pattern matching. This helps with influencer outreach and lead generation. Q: Why do I see truncated text for long posts? A: Threads displays truncated content in the feed. Use the post URL to fetch complete content via HTTP request. Q: How do I see all available data fields? A: In the Apify console, switch from "Preview" to "All fields" view to see complete extracted data including emails, phones, bio_links, and engagement metrics. Q: Why are follower counts and engagement metrics important? A: These metrics help identify influencers, verify account authenticity, measure reach, and analyze content performance for social media monitoring. Q: Does it work with usernames containing dots? A: Yes! Usernames like @user.name are fully supported. Q: What's the best way to find influencers with contact information? A: Use keyword mode with search_filter: "profiles" to discover users. You'll get follower counts, bio data, and any contact information found in their bio. Q: Why am I getting fewer results than my max_posts limit? A: Threads limits the amount of content available through their interface. The actual number of posts available varies based on multiple factors including account activity, content type, and more. ## 💡 Share Your Best Practices If you've discovered effective scraping techniques or encountered issues, please share your feedback: - Leave comments in the Actor's comment section - Report issues via the Issues tab - Rate and provide feedback ## 🆘 Support Having issues or questions? - Check the Apify documentation - View all fields in the dataset for complete data - Contact support through the Apify platform ## 📌 Alternative: Threads API Important Note: This scraper operates without login, which means the amount of accessible data is limited by Threads' public interface. If you need to scrape your own account's data, consider using the official Threads API instead: - ✅ More reliable and stable - ✅ Higher rate limits - ✅ Access to complete post history - ✅ No risk of being blocked - ✅ Official support from Meta The Threads API is the recommended approach for accessing your own account's data or if you need large-scale, production-level data extraction. ## 📚 Disclaimer This tool is provided for educational and research purposes only. Use it responsibly and in accordance with Threads' Terms of Service. --- Keywords*: Threads scraper, Threads API, Meta Threads, social media scraper, Instagram Threads, Threads posts, Threads data extraction, social media monitoring, Threads automation, influencer discovery, follower count scraper Happy Scraping! 🎉