Twitter / X - Scraper - complete suite
by mikolabs
A smart Twitter/X scraper that auto-detects what you need—profiles, tweets, or media—and delivers clean, structured data fast. Perfect for lead gen, research, and automation.
Opens on Apify.com
About Twitter / X - Scraper - complete suite
Need to pull data from Twitter (or X, whatever you're calling it this week)? This scraper is the one I use. You don't have to figure out if you're scraping a profile, a hashtag, or a list of tweets—it just knows. Give it a username, a link, or some keywords, and it figures out the rest, returning everything in clean JSON or CSV. It's fast, which is key when you're testing ideas or tracking trends in real-time. I've used it for building lead lists from user bios, monitoring brand mentions without the API hassle, and archiving conversation threads for analysis. The data comes back structured and ready to drop into a spreadsheet or your database, saving you hours of manual cleanup. If you're tired of wrestling with rate limits or parsing messy HTML, this suite handles the heavy lifting so you can focus on what the data actually means.
What does this actor do?
Twitter / X - Scraper - complete suite is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Twitter / X - Scraper - Complete Suite
Overview
This Apify actor scrapes data from X (Twitter) automatically. You provide inputs like usernames, list URLs, or search terms, and it detects what to scrape—profiles, tweets, lists, or users—returning structured JSON data. It handles pagination and includes rate-limiting protection.
Key Features
- Automatic Routing: Detects the scrape target based on your input (username, list URL, or search query).
- Profile Scraping Modes: Scrapes profiles in Normal, Media Only, or With Replies mode.
- Advanced Filtering: Filter results by date, location, media type, engagement metrics (likes, retweets), and content (verified users, links, safe search).
- Comprehensive Data: Extracts tweets, full profile info (bio, stats, avatar), direct media URLs, and engagement statistics.
- Robust Operation: Built-in retry logic, exponential backoff, and automatic pagination handling.
How to Use
Provide your targets in the actor's input configuration. The actor will determine the appropriate scraping method.
Input Configuration
Primary Input Fields:
* Twitter Usernames: Scrape profiles. Use handles like elonmusk or apify. The actor applies your chosen profile mode (Normal, With Replies, Media Only).
* Twitter List URLs: Scrape all tweets from a list. Supports formats like https://x.com/i/lists/123456.
* Search Terms: Find tweets or users. Use queries like web scraping, AI technology from:apify, or #python.
Key Options & Filters:
* Profile Options: Toggle Include Replies, Include Retweets, or Media Only.
* Search Target: Choose to search for Tweets Globally, Users, or Within Profiles (requires usernames).
* Content Filters: Filter to only images, videos, verified users, quote tweets, or tweets with links.
* Date/Location: Set Start Date and End Date (YYYY-MM-DD) or a Location Filter.
* Engagement Filters: Set minimum thresholds for likes, replies, and retweets.
* Limits: Control the Max Items to Scrape and Max Pages per task.
Output
The actor outputs clean, structured data to an Apify dataset. Each item is a JSON object containing the scraped information, such as:
* Full tweet content and metadata.
* User profile details (bio, follower counts, avatar URL).
* Direct URLs for images and videos.
* Engagement counts (likes, retweets, replies, quotes).
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try Twitter / X - Scraper - complete suite now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- mikolabs
- Pricing
- Paid
- Total Runs
- 108
- Active Users
- 18
Related Actors
🏯 Tweet Scraper V2 - X / Twitter Scraper
by apidojo
Instagram Scraper
by apify
TikTok Scraper
by clockworks
Instagram Profile Scraper
by apify
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support