X(twitter) user profile and tweets scraper

X(twitter) user profile and tweets scraper

by openai

scrapes user timelines from X (Twitter) to extract tweets, user information, and engagement metrics. It works in guest mode without requiring authenti...

21 runs
3 users
Try This Actor

Opens on Apify.com

About X(twitter) user profile and tweets scraper

scrapes user timelines from X (Twitter) to extract tweets, user information, and engagement metrics. It works in guest mode without requiring authentication and can retrieve tweets from any public Twitter account.

What does this actor do?

X(twitter) user profile and tweets scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

X (Twitter) User Timeline Actor This Apify Actor scrapes user timelines from X (Twitter) to extract tweets, user information, and engagement metrics. It works in guest mode without requiring authentication and can retrieve tweets from any public Twitter account. ## Features - Timeline scraping - Extract tweets from any public X (Twitter) user timeline - User information - Retrieve user profile data including verification status - Engagement metrics - Get retweet, like, and reply counts for each tweet - Media detection - Identify tweets with attached media (images, videos) - Guest mode operation - Works without authentication requirements - Proxy support - Uses Apify's residential proxy for reliable requests - Structured output - Results include comprehensive tweet and user data - Configurable limits - Control the number of tweets retrieved ## Input Parameters | Field | Type | Required | Description | | ----------------- | ------- | -------- | ---------------------------------------------------------------- | | username | String | Yes | The username of the Twitter account to scrape (without @ symbol) | | count | Number | No | Number of tweets to retrieve (default: 20, max: 100) | | includeReplies | Boolean | No | Whether to include reply tweets in the results (default: false) | | includeRetweets | Boolean | No | Whether to include retweets in the results (default: true) | ### Example Input json { "username": "elonmusk", "count": 10, "includeReplies": false, "includeRetweets": true } ## How It Works 1. The actor validates the input parameters (username and count) 2. It initializes a proxy configuration using Apify's residential proxy 3. It fetches the user's timeline page from X (Twitter) 4. It parses the HTML to extract tweet data, user information, and engagement metrics 5. Results are pushed to the dataset with structured tweet and user information ## Output The actor outputs a structured object containing: json { "username": "elonmusk", "user_id": "44196397", "tweet_count": 20, "tweets": [ { "id": "1234567890", "text": "Tweet content here", "created_at": "2025-07-07T12:34:56", "retweet_count": 1000, "favorite_count": 5000, "reply_count": 200, "is_retweet": false, "is_reply": false, "user": { "id": "44196397", "name": "Elon Musk", "screen_name": "elonmusk", "verified": true }, "media": [ { "type": "photo", "url": "https://pbs.twimg.com/media/example.jpg" } ] } ] } ## Example Usage ### Get Elon Musk's Timeline json { "username": "elonmusk", "count": 10 } ### Get Timeline with Replies json { "username": "nasa", "count": 20, "includeReplies": true, "includeRetweets": false } ## Limitations - Works in guest mode, so some data may be limited compared to authenticated access - Rate limiting may apply based on Twitter's policies - Some tweets or media might not be accessible in guest mode - Private accounts cannot be scraped

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try X(twitter) user profile and tweets scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
openai
Pricing
Paid
Total Runs
21
Active Users
3
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support