Twitter Get UserByIdOrNameLookUp

An Apify Actor for scraping data from a single Twitter user profile page. It takes a Twitter handle or user ID as input, fetches the page, and extracts profile data using Cheerio for parsing. The scraped data is stored in an Apify dataset for easy access and integration.

Key Features

• Apify SDK: Built using the toolkit for developing and running Apify Actors.
• Input Schema: Uses a defined schema to validate input, such as the target Twitter username or ID.
• Structured Storage: Outputs data to an Apify Dataset, keeping it organized and accessible.
• Axios & Cheerio: Uses Axios for reliable HTTP requests and Cheerio for fast HTML parsing and data extraction on static pages.
• Customizable: The provided code is a template; you can modify the Cheerio selectors to scrape different data points from the profile page.

Input / Output

Input: The Actor requires an input object containing the target twitterHandle or userId. The exact field name is defined by the Actor's input schema.

Example input (JSON):

{
  "twitterHandle": "apify"
}

Output: The scraped data is saved to the Actor's default dataset. The default template extracts page headings (h1-h6), but for this Twitter Actor, the code is modified to extract profile details like display name, bio, follower count, etc. You can access the results via the Apify console, API, or integrations.

How to Use

Running the Actor

1. Build or Access the Actor: Find the "Twitter Get UserByIdOrNameLookUp" Actor in the Apify console or build it from the provided template code.
2. Configure Input: Provide the target Twitter username or user ID in the input field.
3. Run: Start the Actor. It will fetch the profile page, parse it, and store the results.

How It Works (Code Flow)

1. Actor.getInput() retrieves the configured input (the Twitter handle/user ID).
2. axios.get(url) fetches the HTML of the Twitter profile page.
3. cheerio.load(response.data) loads the HTML into Cheerio for parsing.
4. Parsing Logic: The script uses Cheerio selectors to find and extract specific data points from the page structure. You will need to adjust these selectors to target Twitter's profile elements.
   javascript // Example: The template extracts headings. For Twitter, you'd change selectors. // $("h1, h2, h3").each(...) // Original template code // $('[data-testid="UserName"]').text() // Example for Twitter display name
5. Actor.pushData(profileData) stores the extracted profile information into the dataset.

Local Development

To modify or run the Actor locally, use the Apify CLI:

1. Install CLI:
   bash npm -g install apify-cli
   or
   bash brew install apify-cli
2. Pull the Actor: Use the Actor's unique name or ID from the Apify console.
   bash apify pull <ActorId>

Resources

• Apify SDK for JavaScript documentation
• Apify Platform documentation
• Web scraping in Node.js with Axios and Cheerio
• Apify Actor Input Schema guide
• Join the Apify developer community on Discord