Twitter (X.com) Tweets & Profiles Scraper
by scraper-engine
Reliably scrape tweets, profiles, and all public data from X (Twitter) for research, marketing, and lead generation. Outputs clean, structured JSON/CSV ready for analysis.
Opens on Apify.com
About Twitter (X.com) Tweets & Profiles Scraper
Need to pull data from Twitter, but dread the thought of building a scraper that can handle its complex structure and rate limits? I've been there. This actor is what I use to reliably extract tweets and full profile information from X (formerly Twitter). It grabs everything you'd expect: usernames, bios, the actual tweet text, any attached images or videos, precise timestamps, and all the engagement metrics like likes and retweets. It also pulls comprehensive profile details, including follower and following counts and the profile URL. The real value is in how you use that clean, structured data. I've set it up for academic research to track discourse around events, for marketing teams to perform deep competitor analysis, and for agencies building lists of potential influencer partners. It runs on Apify's platform, so you don't have to worry about managing proxies or getting blocked mid-job; you just configure your search (by keyword, user, hashtag, etc.) and let it collect the data at scale. It outputs to formats like JSON and CSV that are ready for your analysis in spreadsheets, BI tools, or custom applications. If you need organized Twitter data without the infrastructure headache, this is a solid solution.
What does this actor do?
Twitter (X.com) Tweets & Profiles Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Twitter (X.com) Tweets & Profiles Scraper
Overview
This Apify actor scrapes public data from X (Twitter) without API limits. It extracts tweets, user profiles, media, and engagement metrics. Use it for data collection, research, lead generation, or monitoring.
Key Features
- Multiple Scrape Modes: Use profile URLs, @handles, tweet URLs, or keyword/hashtag searches.
- Comprehensive Data Extraction:
- Tweets: Full text, timestamps, IDs, URLs, engagement stats (likes, retweets, replies, views), and media (images, videos, GIFs).
- Profiles: Bio, follower/following counts, join date, location, website, avatar.
- Conversations: Optionally capture reply threads and quote tweets.
- Structured Output: Data is formatted for easy analysis and is NLP/AI-friendly.
- Export Formats: JSON, CSV, Excel, RSS, XML, HTML Table.
- Cloud Execution: Runs on Apify with scheduling, proxy support, and reliable performance.
How to Use
- Access the Actor: Find "Twitter X Tweets Profiles Scraper" in the Apify Store.
- Configure Input: In the actor's input, provide one or more of the following:
startUrls: Profile or tweet URLs (e.g.,https://x.com/username).usernames: Handles without the "@" (e.g.,elonmusk).searchTerms: Keywords or hashtags for search-based scraping.
- Set Options: Adjust parameters like
maxTweets,includeReplies, orextractProfileDetailsas needed. - Run: Start the actor. It will execute in the cloud and store results in your Apify dataset.
- Export: Download your data in the preferred format from the dataset.
Input/Output
Main Input Fields:
* startUrls: (Array) Direct URLs to profiles or tweets.
* usernames: (Array) X handles to scrape.
* searchTerms: (Array) Terms to search for on X.
* maxTweets: (Number) Limit the number of tweets scraped.
* includeReplies: (Boolean) Scrape reply threads.
Output (Example JSON snippet):
{
"tweetId": "1234567890",
"text": "Example tweet text.",
"timestamp": "2023-10-01T12:00:00.000Z",
"user": {
"username": "example_user",
"followersCount": 1500,
"bio": "User biography here."
},
"engagement": {
"likeCount": 45,
"retweetCount": 12
},
"media": ["https://pbs.twimg.com/media/example.jpg"]
}
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Twitter (X.com) Tweets & Profiles Scraper now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- scraper-engine
- Pricing
- Paid
- Total Runs
- 15
- Active Users
- 2
Related Actors
🏯 Tweet Scraper V2 - X / Twitter Scraper
by apidojo
Instagram Scraper
by apify
TikTok Scraper
by clockworks
Instagram Profile Scraper
by apify
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support