Xiaohongshu (RED) Scraper 🔍 ## Overview 📋 A powerful and flexible scraper for RedNote(Xiaohongshu/小红书), one of China's largest social media and e-commerce platforms. This actor supports multiple scraping modes and can extract various types of data including search results, comments, user profiles, and user posts. ## Features ⭐ - 🔎 Search Mode: Extract posts based on keywords - 💬 Comment Mode: Collect comments from specific posts - 👤 Profile Mode: Gather user profile information - 📝 User Posts Mode: Scrape all posts from specific users - 🤖 Anti-detection measures built-in - ⚡ Fast and efficient data collection - 🎯 Customizable maximum items limit ## Use Cases 🎯 - Market Research - Influencer Analysis - Content Monitoring - Trend Analysis - Consumer Insights - Competitive Analysis ## Input Parameters 📝 | Parameter | Type | Description | |-----------|------|-------------| | mode | String | Scraping mode: 'search', 'comment', 'profile', or 'userPosts' | | keywords | Array | Keywords for search mode | | postUrls | Array | Post URLs for comment mode | | profileUrls | Array | Profile URLs for profile and userPosts modes | | maxItems | Integer | Maximum number of items to scrape | ## Output Format 📊 The actor provides structured JSON data including: - Post content and metadata - User information - Engagement metrics - Timestamps - Media URLs - Location data (when available) ## Limitations ⚠️ - Respects Xiaohongshu's rate limits - Some content may require authentication - Results may vary based on network conditions ## Tips for Best Results 💡 1. Use reasonable maxItems values to avoid timeouts 2. Space out multiple runs to avoid rate limiting 3. Keep keywords specific for better search results 4. Regularly update your input URLs Need help or have questions? Feel free to reach out! 🤝 ### search mode input Example json { "keywords": [ "ai" ], "maxItems": 20 } ### search mode output sample json [ { "keyword": "ai", "item": { "id": "670a46a50000000024017580", "model_type": "note", "note_card": { "image_list": [ { "height": 1660, "width": 1242, "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1" } ] }, { "width": 1242, "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/cb13ef72141a0909ab3b57587bb769b6/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_mw_1" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/b8d4bba0de0cb741ac7e8d376a23d288/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_prv_1" } ], "height": 1660 }, { "width": 1242, "info_list": [ { "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6d4ef8a530523eebdcbb8e918b63e1b0/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_mw_1", "image_scene": "WB_DFT" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/7122c7c99f28c5c2ed66ae4995b12680/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_prv_1" } ], "height": 1660 }, { "height": 1660, "width": 1242, "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/458a8ee764c354d9dcffecc1b93c970c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_mw_1" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/eac2bd35f2e92f3a2931a472eec4ee7c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_prv_1" } ] }, { "info_list": [ { "url": "http://sns-webpic-qc.xhscdn.com/202501171106/5e4c46ae972bdf4ebe01fea6627c1afa/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_mw_1", "image_scene": "WB_DFT" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6a9fb402316da5ca0aa56ec49b5f537b/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_prv_1" } ], "height": 1660, "width": 1242 }, { "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0cf93838983808e3f5fc0b88b12a2427/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_mw_1" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/33c6bee6e587e28dea26e00bd5a08a41/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_prv_1" } ], "height": 1660, "width": 1242 }, { "height": 1660, "width": 1242, "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0a4ae6466a84fa1e9e947cb3b4fd6894/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_mw_1" }, { "image_scene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/a48ab77a62e1f4ac0b00be5c544212c2/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_prv_1" } ] }, { "height": 1660, "width": 1242, "info_list": [ { "image_scene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d8d9c0de7f30c85f4af984b6c62ac311/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_mw_1" }, { "url": "http://sns-webpic-qc.xhscdn.com/202501171106/3c5083da80364fcb80dd8a26e4dddfbb/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_prv_1", "image_scene": "WB_PRV" } ] }, { "height": 1660, "width": 1242, "info_list": [ { "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d9823a69036cb4800208e8f9b588d7b8/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_mw_1", "image_scene": "WB_DFT" }, { "url": "http://sns-webpic-qc.xhscdn.com/202501171106/4586583b89ac468f08155e2d5c3eee45/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_prv_1", "image_scene": "WB_PRV" } ] } ], "type": "normal", "display_title": "国内AI工具推荐，亲测好用！", "user": { "nick_name": "千寻AI部落", "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo3138f13q208005og26aok1l06olihpp8?imageView2/2/w/80/format/jpg", "user_id": "620232b1000000001000d406", "nickname": "千寻AI部落", "xsec_token": "ABaVqWXGkAIRf-8QqiYwjllFDByVIFaMhzHeALEsf6PWA=" }, "interact_info": { "liked": false, "liked_count": "13759" }, "cover": { "width": 1242, "url_default": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1", "url_pre": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1", "height": 1660 } }, "xsec_token": "AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4=" }, "link": "https://www.xiaohongshu.com/explore/670a46a50000000024017580?xsec_token=AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4=&xsec_source=pc_search&source=web_explore_feed", "scrapedAt": "2025-01-17T03:06:58.355Z" }, ... ] ### comment mode input Example json { "postUrls": [ "https://www.xiaohongshu.com/explore/6764f52c000000000900c655?xsec_token=ABQuGdhHV4zPI_3lR2iWdS9VxX_4RmI3bUSh394ppVitk=&xsec_source=pc_search&source=web_explore_feed" ], "maxItems": 30 } ### comment mode output sample json [ { "postUrl": "https://www.xiaohongshu.com/explore/6764f52c000000000900c655?xsec_token=ABQuGdhHV4zPI_3lR2iWdS9VxX_4RmI3bUSh394ppVitk=&xsec_source=pc_search&source=web_explore_feed", "comment": { "sub_comments": [ { "create_time": 1734965575000, "ip_location": "北京", "target_comment": { "id": "6764f606000000000e01f2e9", "user_info": { "xsec_token": "ABG61P7ExGt1pmyAe585yBJW-gjC5ysiJFg1Jg-g9AU7o=", "user_id": "66178cdc000000000d0248dd", "nickname": "coconut", "image": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31apbclo07c5g5pgnhje3ci6t4k8bcho?imageView2/2/w/120/format/jpg" } }, "id": "67697946000000000d038642", "content": "111", "like_count": "1", "show_tags": [], "user_info": { "user_id": "5dbe41fc00000000010055d4", "nickname": "Julia", "image": "https://sns-avatar-qc.xhscdn.com/avatar/2b4cefbb01e0a0824f5c173dde7f98b2.jpg?imageView2/2/w/120/format/jpg", "xsec_token": "ABjd3DLnAEKK3w2_6aMwp6rShFyiq3XHPptA60BJ5yWJA=" }, "note_id": "6764f52c000000000900c655", "status": 0, "at_users": [], "liked": false } ], "at_users": [], "like_count": "7", "sub_comment_cursor": "67697946000000000d038642", "sub_comment_has_more": true, "content": "28岁ai设计师一枚，工作了两年，最近不忙，打算带几个徒弟，教ai表情包接单，有电脑，18+，观🐷凭伦\"111\"就好啦！", "show_tags": [ "is_author", "user_top" ], "create_time": 1734669831000, "note_id": "6764f52c000000000900c655", "status": 4, "user_info": { "nickname": "coconut", "image": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31apbclo07c5g5pgnhje3ci6t4k8bcho?imageView2/2/w/120/format/jpg", "xsec_token": "ABG61P7ExGt1pmyAe585yBJW-gjC5ysiJFg1Jg-g9AU7o=", "user_id": "66178cdc000000000d0248dd" }, "ip_location": "湖南", "sub_comment_count": "28", "id": "6764f606000000000e01f2e9", "liked": false }, "scrapedAt": "2025-01-17T05:45:22.613Z" }, ... ] ### profile mode input Example json { "profileUrls": [ "https://www.xiaohongshu.com/user/profile/6784ba7f00000000080191fb" ] } ### profile mode output sample json [ { "profileUrl": "https://www.xiaohongshu.com/user/profile/6784ba7f00000000080191fb", "profileData": { "basicInfo": { "redId": "95435108495", "gender": 2, "ipLocation": "美国", "desc": "时尚 | 美国老师\nfashion | teacher", "imageb": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31ckhgbu3gu005ps4n9vi34frj3f5o2o?imageView2/2/w/540/format/webp", "nickname": "hopeawinters", "images": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31ckhgbu3gu005ps4n9vi34frj3f5o2o?imageView2/2/w/360/format/webp" }, "interactions": [ { "count": "40", "type": "follows", "name": "关注" }, { "type": "fans", "name": "粉丝", "count": "206881" }, { "name": "获赞与收藏", "count": "294998", "type": "interaction" } ], "tags": [ { "name": "25岁", "tagType": "info" } ] }, "scrapedAt": "2025-01-17T15:51:01.110Z" }, ... ] ### userPosts mode input Example json { "profileUrls": [ "https://www.xiaohongshu.com/user/profile/639946a0000000002702b173" ], "maxItems": 50 } ### userPosts mode output sample json [ { "profileUrl": "https://www.xiaohongshu.com/user/profile/639946a0000000002702b173", "postData": { "postUrl": "https://www.xiaohongshu.com/explore/6789fdb1000000001c00d095?xsec_token=ABXpV9UyO95kLI6G51DaZsNZIBb3QfMn584SISV_F2QiE=&xsec_source=pc_user", "type": "video", "displayTitle": "只有穷人冬天的被窝才会噼里啪啦的", "user": { "nickName": "显眼包小涛", "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/63994933d9b187973501cb7a.jpg", "userId": "639946a0000000002702b173", "nickname": "显眼包小涛" }, "interactInfo": { "liked": false, "likedCount": "8794", "sticky": false }, "cover": { "width": 694, "url": "", "traceId": "", "infoList": [ { "imageScene": "WB_PRV", "url": "http://sns-webpic-qc.xhscdn.com/202501180028/e8da355f0f66b93801735d44d2403f93/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_prv_1" }, { "imageScene": "WB_DFT", "url": "http://sns-webpic-qc.xhscdn.com/202501180028/9a9667b8e0ea82be10f388b8c279d9d4/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_mw_1" } ], "urlPre": "http://sns-webpic-qc.xhscdn.com/202501180028/e8da355f0f66b93801735d44d2403f93/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_prv_1", "urlDefault": "http://sns-webpic-qc.xhscdn.com/202501180028/9a9667b8e0ea82be10f388b8c279d9d4/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_mw_1", "fileId": "", "height": 925 }, "noteId": "6789fdb1000000001c00d095", "xsecToken": "ABXpV9UyO95kLI6G51DaZsNZIBb3QfMn584SISV_F2QiE=" }, "scrapedAt": "2025-01-17T16:28:25.191Z" }, ... ] ### Related Actors - 🔍 RedNote(Xiaohongshu) Search Scraper - Scrape search results with advanced features for market research and trend analysis - 💬 RedNote (Xiaohongshu) Comments Scraper - Extract detailed comment data with user info and nested replies - 👤 RedNote (Xiaohongshu) Profile Scraper - Get comprehensive user profile data and interaction metrics - 🎥 RedNote(Xiaohongshu) Video Downloader - Download videos with metadata in multiple quality options - 🔄 All-in-One RedNote(Xiaohongshu) Scraper - Complete solution for extracting all types of Xiaohongshu data - 📊 Social Media Influencer Scraper - Discover top influencers across multiple social platforms - 📧 All-in-One Social Media Email Scraper - Extract contact information from 30+ social platforms - 📱 All-in-One Social Media Phone Number Scraper - Discover phone numbers across multiple social platforms - 🔍 Instagram Profile Scraper - Extract detailed Instagram profile data and metrics - 📸 Instagram Posts Scraper - Collect comprehensive post data from multiple users - 💬 Instagram Comments Scraper - Extract comments with user details and engagement metrics - 🎯 Instagram Hashtag Scraper - Scrape hashtag data including top posts and engagement metrics - 🔄 Instagram Tagged Posts Scraper - Extract posts where users have been tagged - 🎥 TikTok Profile Posts Scraper - Extract comprehensive post data from TikTok profiles - 💬 TikTok Comments Scraper - Scrape comments with advanced features and engagement metrics