Twitter Timeline Scraper
by powerai
Scrape tweets and full metadata from any public Twitter timeline with auto-pagination. Get clean, structured data for analysis, research, or monitoring.
Opens on Apify.com
About Twitter Timeline Scraper
Need to pull data from Twitter timelines without hitting rate limits or getting blocked? I've been there. This scraper is what I use to reliably extract tweets from any public profile. It grabs the full metadata you actually need—things like timestamps, engagement metrics, replies, and media links—not just the raw text. The auto-pagination is a lifesaver; it just keeps scrolling and collecting until it's fetched everything or hits the custom limit you set, so you don't have to babysit it. I typically use it for sentiment analysis on brand accounts, tracking competitor content strategies, or building datasets for research projects. It outputs clean, structured JSON that's ready to feed into your analysis scripts or databases. If you're tired of fragile, homemade scraping scripts that break every time Twitter tweaks its front-end, this actor handles the infrastructure headaches for you.
What does this actor do?
Twitter Timeline Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Twitter Timeline Scraper
Overview
This actor scrapes the public timeline of any Twitter user via the Twitter API. It returns an array of tweet objects with detailed metadata, including content, engagement metrics, media attachments, and author information.
Key Features
- Fetches tweets from a specified public user timeline.
- Supports pagination to automatically collect tweets up to a defined maximum.
- Returns comprehensive data for each tweet: ID, timestamp, text, likes, retweets, replies, quotes, views, language, source, media (photos/videos), and author details.
How to Use
Provide the target Twitter username and the maximum number of tweets you want to collect. The actor handles pagination automatically, stopping when it reaches the maxResults limit or when no more tweets are available.
Input
Configure the actor with the following input fields:
| Field | Type | Description |
|---|---|---|
screenname |
string | The Twitter username (without the @ symbol). |
maxResults |
integer | The maximum number of tweets to fetch. |
Output
The output is a JSON array of tweet objects. Each object contains a detailed set of fields. The structure of a typical tweet in the output is shown below.
{
"tweet_id": "1927977858812760412",
"created_at": "Thu May 29 06:38:36 +0000 2025",
"text": "https://t.co/CSwbjnzNao",
"favorites": 24255,
"retweets": 3061,
"replies": 2367,
"quotes": 224,
"views": "1781258",
"lang": "zxx",
"source": "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>",
"media": {
"video": [
{
"media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1796190801073950721/pu/img/GFLwceK_ddA8a1sJ.jpg",
"variants": [...],
"duration": 41770
}
]
},
"author": {
"rest_id": "44196397",
"name": "Elon Musk",
"screen_name": "elonmusk",
"avatar": "https://pbs.twimg.com/profile_images/1926284313365979137/o2cF3MeJ_normal.jpg",
"blue_verified": true
},
"scrapedAt": "2025-05-29T09:02:38.547Z"
}
Notes
- This actor only works with public Twitter timelines.
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Twitter Timeline Scraper now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- powerai
- Pricing
- Paid
- Total Runs
- 762
- Active Users
- 49
Related Actors
🏯 Tweet Scraper V2 - X / Twitter Scraper
by apidojo
Instagram Scraper
by apify
TikTok Scraper
by clockworks
Instagram Profile Scraper
by apify
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support