Twitter Posts Scraper

Twitter Posts Scraper

by pratikdani

Need to pull data from Twitter posts without the manual hassle? This scraper does the heavy lifting for you. Give it any public tweet URL, and it’ll ...

313,866 runs
530 users
Try This Actor

Opens on Apify.com

About Twitter Posts Scraper

Need to pull data from Twitter posts without the manual hassle? This scraper does the heavy lifting for you. Give it any public tweet URL, and it’ll return a clean dataset with the post text, full user details (handle, display name, bio), and all the engagement metrics—likes, retweets, replies, and quote tweets. It also captures media links, timestamps, and the tweet’s direct URL for reference. I use this to monitor brand mentions and track how specific conversations evolve over time. It’s great for sentiment analysis, competitor research, or just gathering public feedback on a topic. For lead generation, you can identify engaged users in your niche based on who’s interacting with relevant tweets. The setup is straightforward: input your target URLs, run the actor, and get structured JSON or CSV output. It handles rate limits gracefully, so you can scrape reliably. Whether you’re a marketer analyzing campaign performance, a researcher studying social trends, or a developer feeding data into a dashboard, this tool turns public Twitter data into actionable information.

What does this actor do?

Twitter Posts Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

Twitter Posts Scraper Interested in using this scraper? Get it here: Twitter Posts Scraper. Scrape Twitter posts and extract detailed information in bulk. ## Features Comprehensive Data Extraction: Extract detailed data from Twitter posts including text content, user information, engagement metrics, and media attachments. This allows for a complete analysis of the posts' reach and user interaction. Data Export and Integration: Once the scraping process is complete, you can easily export the extracted data in various formats such as JSON, CSV, or Excel. You can select the fields you want, allowing for seamless integration with other tools and platforms for further analysis and utilization. Automatic Retry and Error Handling: In case of temporary issues like network failures or timeouts, the scraper has built-in automatic retry functionality. It intelligently handles errors to ensure a smooth and uninterrupted scraping experience. Ability to Resume Last Failed Runs: In case of unexpected errors, you can simply go to the scraper's last run page and click on the 'Resurrect' button to resume the last scraping progress. ## Sample Output Here is a sample output of this scraper: json { "biography": "Here we go! © fabrizio.romano93@gmail.com 📩", "bookmarks": 756, "date_posted": "2023-07-24T19:26:23.000Z", "description": "Here we go? Al Hilal you can take me. I look like Kylian Mbappe", "external_url": null, "followers": 21754744, "following": 2583, "hashtags": null, "id": "1683559267524136962", "input": { "url": "https://x.com/FabrizioRomano/status/1683559267524136962/" }, "is_verified": false, "likes": 259030, "name": "Fabrizio Romano", "photos": null, "posts_count": 46594, "profile_image_link": "https://pbs.twimg.com/profile_images/1741753635158024192/j0m8Ucvv_normal.jpg", "quoted_post": { "date_posted": null, "description": "Al Hilal you can take me. I look like Kylian Mbappe 😂😂👀 https://t.co/VH0syez3VX", "photos": [ "https://pbs.twimg.com/media/F10rS33WwAAJOQo.jpg" ], "post_id": "1683549442287255552", "profile_id": "Giannis_An34", "profile_name": "Giannis Antetokounmpo", "url": "https://x.com/Giannis_An34/status/1683549442287255552", "videos": null }, "quotes": 607, "replies": 2752, "reposts": 14319, "tagged_users": null, "url": "https://x.com/FabrizioRomano/status/1683559267524136962", "user_posted": "FabrizioRomano", "videos": null, "views": 19844857 } ## Output Data Documentation Here is the JSON fields documentation without including the sample values: - biography (string): The biography or description associated with the user's profile. - bookmarks (integer): The number of times the post has been bookmarked by users. - date_posted (string): The date and time when the post was created, in ISO 8601 format. - description (string): The text content of the post. - external_url (string or null): A URL related to the post or user's profile. This can be an external link shared in the profile or post. - followers (integer): The number of followers the user has. - following (integer): The number of accounts the user is following. - hashtags (array or null): An array of hashtags used in the post. - id (string): A unique identifier for the post. - input (object): Contains details about the input parameters used to retrieve the post. - url (string): The URL of the post. - is_verified (boolean): Indicates whether the user's account is verified on the platform. - likes (integer): The number of likes the post has received. - name (string): The name associated with the user's profile. - photos (array or null): An array of URLs pointing to photos included in the post. - posts_count (integer): The total number of posts the user has made on the platform. - profile_image_link (string): The URL to the user's profile image. - quoted_post (object or null): Details of the post that is being quoted or replied to, if applicable. - date_posted (string or null): The date and time when the quoted post was created, in ISO 8601 format. - description (string): The text content of the quoted post. - photos (array or null): An array of URLs pointing to photos included in the quoted post. - post_id (string): The unique identifier of the quoted post. - profile_id (string): The unique identifier of the user who created the quoted post. - profile_name (string): The name associated with the profile of the quoted post's creator. - url (string): The URL of the quoted post. - videos (array or null): An array of URLs pointing to videos included in the quoted post. - quotes (integer): The number of times the post has been quoted. - replies (integer): The number of replies to the post. - reposts (integer): The number of times the post has been reposted. - tagged_users (array or null): An array of users tagged in the post. - url (string): The URL of the post. - user_posted (string): The username of the person who posted the content. - videos (array or null): An array of URLs pointing to videos included in the post. - views (integer): The number of views the post has received.

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try Twitter Posts Scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
pratikdani
Pricing
Paid
Total Runs
313,866
Active Users
530
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support