Twitter (X.com) Tweets Scraper

Overview

An Apify actor that scrapes tweets from Twitter (X.com), extracting media files and metadata. It downloads videos, images, and audio, storing them in Apify's Key-Value Store and returning structured data. Useful for archiving content, data analysis, or media collection.

Key Features

• Media Download: Fetches videos (multiple resolutions: 1280p, 852p, 568p), images, and separate audio tracks.
• Comprehensive Metadata: Returns tweet IDs, thumbnails, counts of media items, available resolutions, and format details.
• Batch Processing: Handles multiple tweet URLs in a single run.
• Structured Output: Provides organized JSON data with success/failure status and direct download URLs from Apify storage.

How to Use

1. Provide a list of tweet URLs in the actor's input.
2. Run the actor. It will scrape each tweet, download the media to Apify Key-Value Store, and generate a JSON report.
3. Retrieve the output dataset, which contains metadata and temporary URLs to download the media files.

Input

Configure the actor using a JSON input. The key_value parameter must be set to true to enable media storage.

{
  "key_value": true,
  "post_urls": [
    { "url": "https://x.com/user/status/1234567890" },
    { "url": "https://x.com/another_user/status/0987654321" }
  ]
}

• key_value (Boolean, Required): Enables Apify Key-Value Store for media storage.
• post_urls (Array, Required): List of objects, each containing a url key with a valid Twitter (X.com) tweet URL.

Output

The actor outputs an array of objects, one per processed tweet. Each object contains the status, original URL, metadata, and arrays of extracted videos, images, and audios with their storage URLs.

[
  {
    "success": true,
    "tweet_url": "https://x.com/user/status/1234567890",
    "metadata": {
      "title": "Tweet text here",
      "twitter_id": "1234567890",
      "thumbnail": "https://pbs.twimg.com/.../image.jpg",
      "video_count": 1,
      "image_count": 0,
      "audio_count": 1,
      "available_resolutions": ["1280p", "852p"],
      "available_formats": ["mp4"]
    },
    "videos": [
      {
        "format": "mp4",
        "quality": "1280p",
        "kv_store_url": "https://api.apify.com/v2/key-value-stores/.../video.mp4?token=..."
      }
    ],
    "images": [],
    "audios": [
      {
        "format": "mp3",
        "kv_store_url": "https://api.apify.com/v2/key-value-stores/.../audio.mp3?token=..."
      }
    ]
  }
]

Key Output Fields:
* success: Boolean indicating if the scrape was successful.
* tweet_url: The original URL processed.
* metadata: Contains the tweet ID, text, thumbnail URL, and counts of media items.
* videos / images / audios: Arrays of objects for each media type. Each object includes the file format and a kv_store_url—a temporary, authenticated URL to download the file from Apify's Key-Value Store.