Twitter video downloader Download multiple videos from Twitter / X.com and save them to Apify key value store ## Supported URLs * https://twitter.com/username/status/... * https://x.com/username/status/... * https://twitter.com/i/status/... * https://x.com/i/status/... ## Custom data If you need to pass custom data to the output, set the userData object of the request in the startUrls array and it will be appended to the output json { "startUrls": [{ "url": "https://www.twitter.com/.../status/...", "userData": { "userid": "1454784661528485889" } }] } ## Integration Integrates with the https://apify.com/pocesar/merge-key-value-store-pieces to merge the output as one output for each chunks downloaded. Otherwise, check the way for doing this manually below. ## Output The generated output is the following: jsonc { "url": "https://x.com/apify/status/1454784661528485889", // original URL requested "hash": "83143134", // the internal hash of the video, never changes between requests "partsUrl": "https://api.apify.com/v2/key-value-stores/SOME_ID/records/83143134", // the URL to the Key Value store where the video parts are stored "userData": { "userid": "1454784661528485889" }, "#error": false // hidden field if there was an error } The video is chunked in parts of ~2MB each and saved to the Key Value store. To be able to download it, you'll need to download all the parts and concatenate them together. Here's a small example that can be used in the browser: js const { appendFileSync } = require('node:fs'); async function main(datasetId) { const items = await fetch(`https://api.apify.com/v2/datasets/${datasetId}/items?clean=true&format=json`).then((response) => response.json()); const firstVideo = items[0].partsUrl; // partsUrl contains the location to the Key Value store // get the parts from the Key value store const { parts, length, contentType } = await fetch(firstVideo).then((response) => response.json()); console.log({ parts, length, contentType }); // wait for all parts to be downloaded for (const url of parts) { // download part using fetch const downloaded = await fetch(url); // get an arrayBuffer from the chunk const arrayBuffer = new Uint8Array(await downloaded.arrayBuffer()); console.log(`Downloaded ${arrayBuffer.byteLength} bytes from ${url}`); // write downloaded chunk to file appendFileSync('video.mp4', arrayBuffer); } } main('YOUR_DATASET_ID');