Twitter Communities Top Posts Scraper
by powerai
Scrape top posts from Twitter communities by keyword with auto-pagination. Get detailed post data like author, text, and engagement for lead gen and research.
Opens on Apify.com
About Twitter Communities Top Posts Scraper
Need to know what's actually trending in those Twitter communities? This scraper cuts through the noise. Just give it a keyword, and it'll pull the top posts from relevant Twitter communities, automatically handling pagination to get you everything. It's built for when you're tired of manual scrolling and need structured data fast. You get the full details on each post—think author handle, post text, timestamps, and engagement metrics. Set a maxResults limit so it fetches exactly the amount of data you need, nothing more, nothing less. I use it for spotting emerging conversations, tracking brand mentions in niche groups, and gathering leads from active community discussions. It saves hours you'd otherwise spend copying and pasting, delivering clean JSON or CSV that's ready for analysis or feeding into your own dashboards. If you're researching communities, monitoring trends, or building a dataset around a specific topic, this is the straightforward tool that gets the job done.
What does this actor do?
Twitter Communities Top Posts Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Twitter Communities Top Posts Scraper
Scrapes the top posts from Twitter (X) communities based on a search keyword or phrase. It uses the latest Twitter API and handles pagination automatically to collect the number of posts you specify.
Key Features
- Keyword Search: Fetches top community posts matching a search query.
- Automatic Pagination: Handles scrolling to collect large result sets.
- Configurable Limit: Set the maximum number of posts to retrieve.
- Detailed Output: Returns comprehensive data for each post, including metrics, user info, and media.
How to Use
Provide a query to search for. Optionally, specify a maxResults limit. The actor will return an array of post objects.
Input
Configure the actor with the following input fields:
query(string, required): The keyword or phrase to search for within Twitter communities.maxResults(integer, optional): The maximum number of community posts to fetch. Defaults to20.
Example Input
{
"query": "AI",
"maxResults": 20
}
Output
The actor outputs an array of objects, where each object represents a community post. Key fields include:
tweet_id,screen_name,author_id,community_idtext,lang,created_at,source- Engagement metrics:
favorites,quotes,replies,retweets,views user_info: Detailed profile information for the post author.entities&media: Contains hashtags, URLs, and attached media (photos, videos) with full metadata.
Example Output (Abbreviated)
[
{
"tweet_id": "1919031648391176434",
"screen_name": "example_user",
"favorites": 66550,
"created_at": "Sun May 04 14:09:33 +0000 2025",
"text": "Example tweet text...",
"lang": "in",
"quotes": 3225,
"replies": 1488,
"retweets": 4965,
"views": "7519017",
"community_id": "1562271278744354816",
"author_id": "1540299945647165440",
"user_info": { ... },
"media": [ ... ]
}
]
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Twitter Communities Top Posts Scraper now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- powerai
- Pricing
- Paid
- Total Runs
- 177
- Active Users
- 9
Related Actors
🏯 Tweet Scraper V2 - X / Twitter Scraper
by apidojo
Instagram Scraper
by apify
TikTok Scraper
by clockworks
Instagram Profile Scraper
by apify
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support