Twitter Timeline Scraper

Twitter Timeline Scraper

by powerai

Scrape tweets and full metadata from any public Twitter timeline with auto-pagination. Get clean, structured data for analysis, research, or monitoring.

762 runs
49 users
Try This Actor

Opens on Apify.com

About Twitter Timeline Scraper

Need to pull data from Twitter timelines without hitting rate limits or getting blocked? I've been there. This scraper is what I use to reliably extract tweets from any public profile. It grabs the full metadata you actually need—things like timestamps, engagement metrics, replies, and media links—not just the raw text. The auto-pagination is a lifesaver; it just keeps scrolling and collecting until it's fetched everything or hits the custom limit you set, so you don't have to babysit it. I typically use it for sentiment analysis on brand accounts, tracking competitor content strategies, or building datasets for research projects. It outputs clean, structured JSON that's ready to feed into your analysis scripts or databases. If you're tired of fragile, homemade scraping scripts that break every time Twitter tweaks its front-end, this actor handles the infrastructure headaches for you.

What does this actor do?

Twitter Timeline Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

Twitter Timeline Scraper

Overview

This actor scrapes the public timeline of any Twitter user via the Twitter API. It returns an array of tweet objects with detailed metadata, including content, engagement metrics, media attachments, and author information.

Key Features

  • Fetches tweets from a specified public user timeline.
  • Supports pagination to automatically collect tweets up to a defined maximum.
  • Returns comprehensive data for each tweet: ID, timestamp, text, likes, retweets, replies, quotes, views, language, source, media (photos/videos), and author details.

How to Use

Provide the target Twitter username and the maximum number of tweets you want to collect. The actor handles pagination automatically, stopping when it reaches the maxResults limit or when no more tweets are available.

Input

Configure the actor with the following input fields:

Field Type Description
screenname string The Twitter username (without the @ symbol).
maxResults integer The maximum number of tweets to fetch.

Output

The output is a JSON array of tweet objects. Each object contains a detailed set of fields. The structure of a typical tweet in the output is shown below.

{
  "tweet_id": "1927977858812760412",
  "created_at": "Thu May 29 06:38:36 +0000 2025",
  "text": "https://t.co/CSwbjnzNao",
  "favorites": 24255,
  "retweets": 3061,
  "replies": 2367,
  "quotes": 224,
  "views": "1781258",
  "lang": "zxx",
  "source": "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>",
  "media": {
    "video": [
      {
        "media_url_https": "https://pbs.twimg.com/ext_tw_video_thumb/1796190801073950721/pu/img/GFLwceK_ddA8a1sJ.jpg",
        "variants": [...],
        "duration": 41770
      }
    ]
  },
  "author": {
    "rest_id": "44196397",
    "name": "Elon Musk",
    "screen_name": "elonmusk",
    "avatar": "https://pbs.twimg.com/profile_images/1926284313365979137/o2cF3MeJ_normal.jpg",
    "blue_verified": true
  },
  "scrapedAt": "2025-05-29T09:02:38.547Z"
}

Notes

  • This actor only works with public Twitter timelines.

Categories

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try Twitter Timeline Scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
powerai
Pricing
Paid
Total Runs
762
Active Users
49
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support