Twitter Get UserTweetsAndReplies V2

Name: Twitter Get UserTweetsAndReplies V2
Author: twitterapi

by twitterapi

Extract a Twitter/X user's full public conversation history, including their tweets and replies, for research, analysis, and archiving. Get structured data ready for your projects.

567 runs

22 users

Try This Actor

Opens on Apify.com

About Twitter Get UserTweetsAndReplies V2

Need to pull a user's entire Twitter conversation history, not just their top tweets? This actor is built for that. It crawls a target Twitter/X profile and extracts both their original tweets and their replies to others, giving you the full picture of their activity on the platform. I use it for social listening, competitive research, and gathering datasets for sentiment analysis. You just provide the target username, and it handles the rest, navigating through the profile to collect the data. The results are delivered in a clean, structured format like JSON or CSV, making it easy to plug into your analysis tools or databases. It's particularly useful for understanding engagement patterns, tracking brand mentions in conversations, or archiving a user's public interactions. The V2 update means better reliability against recent platform changes. If you've ever been frustrated by APIs or scrapers that only get surface-level posts, this one digs deeper to get the threads and replies that often contain the most valuable insights.

What does this actor do?

Twitter Get UserTweetsAndReplies V2 is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

Cloud-based execution - no local setup required
Scalable infrastructure for large-scale operations
API access for integration with your applications
Built-in proxy rotation and anti-blocking measures
Scheduled runs and webhooks for automation

How to Use

Click "Try This Actor" to open it on Apify
Create a free Apify account if you don't have one
Configure the input parameters as needed
Run the actor and download your results

Documentation

Twitter Get UserTweetsAndReplies V2

Categories: AUTOMATION, SOCIAL_MEDIA

Overview

This Actor scrapes a Twitter/X user's tweets and replies from a single profile page. It is built as a JavaScript template for scraping data from a single web page. The Actor fetches the page HTML using Axios, parses the content with Cheerio, and stores the extracted data in an Apify dataset. While the example code extracts page headings, you can modify it to target specific tweet data from a Twitter profile.

Key Features

Apify SDK: Toolkit for building and running Actors.
Input Schema: Validates the Actor's input configuration.
Dataset Storage: Saves structured results where each item has consistent attributes.
Axios Client: Promise-based HTTP client for fetching page HTML.
Cheerio: Fast, server-side HTML parsing and manipulation library.

Input/Output

Input: The primary input is a url parameter pointing to the Twitter profile page you want to scrape (e.g., https://x.com/username). The input is defined and validated using an input schema.

Output: Scraped data is stored in an Apify dataset. By default, the template stores page headings. For scraping tweets, you would adapt the Cheerio selector to target tweet elements, and the output would typically include fields like tweet text, timestamp, likes, and retweets.

How to Use

Configure Input: Provide the target Twitter profile URL via the Actor's input.
Execution: The Actor runs the following process:
- Retrieves the input using Actor.getInput().
- Fetches the page HTML with axios.get(url).
- Loads the HTML into Cheerio for parsing: cheerio.load(response.data).
- Extracts data using Cheerio selectors. The default example extracts headings:
  javascript $("h1, h2, h3, h4, h5, h6").each((_i, element) => {...});
- Stores the results using Actor.pushData(headings).
Get Results: Access the scraped tweet data from the Actor's dataset after the run completes.

Local Development

To develop locally, pull the Actor using the Apify CLI:
1. Install the CLI via Homebrew (brew install apify-cli) or npm (npm -g install apify-cli).
2. Pull the Actor using its unique name or ID:
bash apify pull <ActorId>