Lemon8 Media Scraper Lightweight scraper that extracts image and video URLs from Lemon8 posts. Focused on media extraction only - no comments, no post details, just clean media URLs. ## Features - Image Extraction - Get all image URLs from posts - Video Extraction - Extract video URLs from video posts - Search Discovery - Find posts by keyword search - Direct URLs - Scrape specific post URLs - High Quality - Auto-convert thumbnails to high-quality URLs - Media Download - Optional download to Apify key-value store - Crash Recovery - Resume from where you left off if interrupted - Multiple Regions - Support for 10+ countries - Stealth Browser - Uses Camoufox to avoid detection ## Output Data Each post is saved as a separate item in the dataset: json { "postId": "7543408422994264589", "postUrl": "https://www.lemon8-app.com/@username/7543408422994264589?region=us", "images": [ { "url": "https://p16-lemon8-sign-va.tiktokcdn.com/tos-maliva-v-ac5634-us/...", "alt": "Post image description", "type": "image" } ], "videos": [], "imageCount": 5, "videoCount": 0 } ### With Media Download Enabled When downloadMedia: true, each media item includes a keystoreKey: json { "postId": "7543408422994264589", "images": [ { "url": "https://p16-lemon8-sign-va.tiktokcdn.com/...", "alt": "Post image", "type": "image", "keystoreKey": "7543408422994264589_img_0.webp" } ], "videos": [ { "url": "https://v16-lemon8.tiktokcdn.com/...", "poster": "https://p16-lemon8-sign-va.tiktokcdn.com/...", "type": "video", "keystoreKey": "7543408422994264589_vid_0.mp4" } ], "imageCount": 1, "videoCount": 1 } ## Input Options | Option | Type | Default | Description | |--------|------|---------|-------------| | postUrls | Array | [] | Direct post URLs to scrape (overrides searchTerm) | | searchTerm | String | "fashion" | Search keyword for discovery page | | region | String | "us" | Region code | | limit | Number | 2 | Maximum posts to process (1-100) | | saveImages | Boolean | true | Extract image URLs | | saveVideos | Boolean | true | Extract video URLs | | downloadMedia | Boolean | false | Download files to key-value store | | highQuality | Boolean | true | Convert to high-quality URLs | | maxScrolls | Number | 2 | Max scrolls on discovery (1-30) | | scrollDelay | Number | 1000 | Delay between scrolls in ms | | clearStorage | Boolean | false | Clear request queue and start fresh | | proxy | Object | null | Apify proxy configuration | ### Example: Search Discovery json { "searchTerm": "fashion", "region": "us", "limit": 20, "saveImages": true, "saveVideos": true, "downloadMedia": false } ### Example: Direct Post URLs json { "postUrls": [ "https://www.lemon8-app.com/@username/7543408422994264589", "https://www.lemon8-app.com/@another/7550145067198005791" ], "downloadMedia": true } ### Available Regions | Code | Region | |------|--------| | us | United States | | au | Australia | | nz | New Zealand | | jp | Japan | | th | Thailand | | id | Indonesia | | vn | Vietnam | | my | Malaysia | | sg | Singapore | | ca | Canada | ## Crash Recovery & Rerun This actor uses Apify's Request Queue for state persistence: - Resume after crash: Simply Resurrect the failed run - it will continue from unprocessed posts - Start fresh: Set clearStorage: true in input, or start a new run (not resurrect) ### How it works: 1. All post URLs are added to a persistent Request Queue before processing 2. Each post is marked as "handled" only after successful extraction 3. Each post is saved to the dataset immediately (incremental saves) 4. On restart, only unhandled requests are processed ## Storage ### Key-Value Store - INPUT - Run configuration - OUTPUT - Complete results with all media - METADATA - Run statistics (totalPosts, totalImages, totalVideos, downloadedFiles) - {postId}_img_{index}.webp - Downloaded images (if enabled) - {postId}_vid_{index}.mp4 - Downloaded videos (if enabled) ### Dataset Each post saved as a separate item for easy export and processing. ### Accessing Downloaded Files https://api.apify.com/v2/key-value-stores/{storeId}/records/{keystoreKey} ## Use Cases - Content Archiving - Save media from posts before they disappear - Dataset Building - Collect images for ML training data - Visual Analysis - Analyze trending visual styles and formats - Competitor Research - Monitor competitor visual content - Content Inspiration - Discover popular image styles