X (Twitter) User Scraper

X (Twitter) User Scraper

by lumen_limitless

A reliable web scraper for X (Twitter) that extracts user profiles and tweet data using Crawlee and Playwright, perfect for research and analysis.

2,606 runs
259 users
Try This Actor

Opens on Apify.com

About X (Twitter) User Scraper

Need to pull data from X (Twitter) for research, analysis, or building a dataset? This actor is a straightforward scraper built with Crawlee and Playwright that handles the heavy lifting. I've used it to reliably extract detailed user profiles—think bios, follower counts, and verification status—along with their public tweet history. It's particularly handy for sentiment analysis, tracking brand mentions, or gathering competitive intelligence without dealing with the platform's API limits. The setup is familiar if you've worked with headless browsers; you configure your target accounts and what data points you need, and it returns structured JSON. It saves you from writing and maintaining your own scraping scripts, which is a win when X's frontend changes. Just point it at the right profiles and let it compile the data for you.

What does this actor do?

X (Twitter) User Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

X (Twitter) User Scraper

Website Content Crawler Actor

Overview

This actor is a web scraper built with Crawlee and Playwright. It extracts user profile data and the 100 most liked tweets from a specified X (Twitter) user's timeline.

Key Features

  • Extracts detailed user profile information.
  • Collects the user's 100 most liked recent tweets.
  • Uses Playwright for browser automation to handle X's dynamic content.
  • Built on Crawlee for efficient and structured crawling.

How to Use

  1. In the actor's input configuration, set the target X profile URL in the startUrls array.
  2. Optionally, adjust the maxRequestsPerCrawl value to limit requests.
  3. Run the actor. It will navigate to the profile, scrape the data, and deliver structured output.

Input/Output

Input: The primary input is a startUrls array containing the full URL of the X user profile to scrape (e.g., https://x.com/username).

Output: The actor outputs structured JSON data containing two main objects:

  1. User Object: Comprehensive profile data including ID, screen name, verification status, follower counts, description, and profile images.
  2. Tweet Objects: An array of the user's 100 most liked tweets, each containing details like tweet ID, content, and engagement metrics.

Example Output Snippet (User Object):

"user": {
  "legacy": {
    "name": "Elon Musk",
    "screen_name": "elonmusk",
    "followers_count": 189827332,
    "description": "",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1780044485541699584/p78MCn3B_normal.jpg"
  },
  "is_blue_verified": true
}

Categories

SOCIAL_MEDIA

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try X (Twitter) User Scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
lumen_limitless
Pricing
Paid
Total Runs
2,606
Active Users
259

Related Actors

🏯 Tweet Scraper V2 - X / Twitter Scraper

🏯 Tweet Scraper V2 - X / Twitter Scraper

by apidojo

 Instagram Scraper

Instagram Scraper

by apify

 TikTok Scraper

TikTok Scraper

by clockworks

 Instagram Profile Scraper

Instagram Profile Scraper

by apify
Browse All Actors
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support