Skool Scraper

Skool.com Scraper is an Apify actor that allows you to extract detailed information about groups and members from Skool.com, a platform for online communities and courses. This scraper can collect data on group details, creator information, and member profiles, providing valuable insights for market research, competitor analysis, or community engagement strategies. ## Why use Skool.com Scraper? - Comprehensive Data Collection: Gather extensive information about Skool.com groups, including descriptions, member counts, pricing, and more. - Member Insights: Extract detailed profiles of group members, including their bios, social media links, and activity data. - Flexible Scraping Options: Choose to focus on either group information or member details based on your specific needs. - Discovery Capabilities: Utilize the discovery feature to find and scrape multiple groups automatically. ## How to use Skool.com Scraper https://www.youtube.com/watch?v=_aPOHOdq4mA 1. Set up your Input: - Provide start URLs from Skool.com (e.g., group pages or discovery URLs). - Set the maximum number of requests per crawl. - Enter your Skool.com cookies. - Choose whether to scrape group information or member details. 2. Run the Actor: Start the actor and let it crawl the specified Skool.com pages. 3. Retrieve Results: Once the run is complete, download the scraped data in your preferred format (JSON, CSV, or Excel). ## Input Configuration json { "startUrls": [ { "url": "https://www.skool.com/coin/about" }, { "url": "https://www.skool.com/discovery?q=f" } ], "maxRequestsPerCrawl": 1000, "cookies": "COOKIES_HERE", "info": "members" } - startUrls: Array of Skool.com URLs to begin scraping from. - maxRequestsPerCrawl: Limit on the number of requests per run (default: 1000). - cookies: JSON array of cookies to use for authentication. - info: Choose between "groups" or "members" to specify the type of data to scrape. ### Obtaining an Auth Token To obtain an authentication token, follow these steps: 1. Install the Copy Cookies browser extension. 2. Go to Skool.com. 3. Log in to your account. 4. Click on the extension icon to copy your cookies. 5. Paste the cookies into the cookies field in the input. ## Output The actor provides detailed output for either groups or members, depending on your configuration. Here's an example of member data: json { "group_slug": "darmowyrenesans", "id": "221bdda6b5a8457d9096e9be5a6b4d8f", "name": "bartosz-oses-2175", "email": "", "first_name": "Bartosz", "last_name": "Oses", "created_at": "2024-09-24T18:20:57.790372Z", "updated_at": "2024-10-09T13:01:03.371098Z", "bio": "\"Ask yourself a final question - Are you going down or up?\" ~Jahseh Onfroy", "last_offline": 1728475786666445600, "facebook": "", "instagram": "https://www.instagram.com/b4tar_/", "linkedin": "", "twitter": "", "website": "https://open.spotify.com/artist/2iMxwhwinO7w378ognlyMX?si=iGqj36F5S4mtm8_7BIJMwQ", "youtube": "https://youtube.com/@b4tar_?si=0TEeJ7Ve8MRAlD9r", "location": "Poznań", "myers_briggs": "", "picture": "https://assets.skool.com/f/221bdda6b5a8457d9096e9be5a6b4d8f/ed34272b434848679d9dded804f5c5be9b78495449a3425cb5a77702689dc618-md.jpg" } Here's an example of group data: json { "group_id": "463ab648c8674abe9e75cc6b1f2c7685", "group_slug": "stocks", "group_name": "The Vault", "group_description": "The Largest Stocks, Options, And Futures Trading Community. Learn strategies from pro traders themselves and watch them trade live.\nLinks below 👇🏻\n\n", "group_info": "Welcome to The Vault --> The Largest Stocks, Options, and Futures Trading Group on Skool.\n\nWhat We Offer:\n[ul][li]Exclusive Courses: Our courses cover Market Structure, Supply/Demand Mastery, Beginner Trading Concepts, Stock Scanning, and Market Profile Mastery.[li]Expert Insights: Learn from Jordan, our founder with over 6 years of trading experience. His journey, insights, and strategies are at your fingertips.[li]Real-Time Learning: Engage in live trading sessions with expert coaches, offering practical, real-world application.[li]Valuable Resources: Unlock a treasure trove of unreleased courses, PDFs, and trade secrets that can set you on the path to being among the 10% of successful traders.\n", "group_num_courses": 18, "group_num_modules": 79, "group_admins": 14, "group_total_members": 11631, "group_online_members": 41, "group_total_posts": 4348, "group_creation_date": "2024-01-11T19:15:49.021162Z", "group_updated_date": "2024-10-09T19:26:24.813699Z", "group_leaderboard_users": [], "group_levels": [], "group_labels": [], "group_image": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/82fe989131834a608b686861e316b1f8221b1ec784864bd6b0f36ebf7736056a-md.jpg", "group_favicon": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/6bb73f79808546d2b326b892fde96aadb0ad6175d1244454a3e83306d63b91db", "group_big_logo": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/82fe989131834a608b686861e316b1f8221b1ec784864bd6b0f36ebf7736056a", "group_logo": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/57ed300147d548beab475763b3fa03c25f309c12d9814d0bb330e4348e643b74", "group_color": "#009E5D", "group_links": [ "https://hoo.be/freedomteam" ], "group_survey_updated_at": "2024-04-24T10:06:24.702103674Z", "group_survey_questions": [ "What's your trading account size?", "What markets do you trade?", "By checking the box below, you agree to all terms and conditions, disclaimers, and privacy policy associated with Freedom Team Trading." ], "group_attachments": [ { "id": "40be0580306349b1a1ab07e9f920b000", "landing_page_attachment_type": 2, "image": { "file_id": "", "original_url": "" }, "video": { "video_url": "https://freedomteamtrading.wistia.com/medias/b1cx4jv607", "original_thumbnail_url": "https://embed-ssl.wistia.com/deliveries/fd2dbaef0b4285ffa9ac5602bae2c2ad.jpg?image_crop_resized=960x540", "video_length_ms": 233876 } }, { "id": "74ec504966d745ccae4f8bf9d8f4d1a2", "landing_page_attachment_type": 2, "image": { "file_id": "", "original_url": "" }, "video": { "video_url": "https://freedomteamtrading.wistia.com/medias/irez6t594a", "original_thumbnail_url": "https://embed-ssl.wistia.com/deliveries/9791ebc0d893a770c98b0ab3cfdd50b13bda4fe5.jpg?image_crop_resized=960x540", "video_length_ms": 67780 } }, { "id": "c91e63c20f714260b8b92a445cb7a276", "landing_page_attachment_type": 1, "image": { "file_id": "b2440f6c092644daa38f6667ec5cf6ac", "original_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/3d020d07f0224e11a77272a6110326ee0823cd88368e47c2bc503a58ca832261", "small_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/3d020d07f0224e11a77272a6110326ee0823cd88368e47c2bc503a58ca832261-sm.png", "big_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/3d020d07f0224e11a77272a6110326ee0823cd88368e47c2bc503a58ca832261-md.png" }, "video": { "video_url": "", "original_thumbnail_url": "" } }, { "id": "fd345f3f77b441f29622a2aff4abe60e", "landing_page_attachment_type": 1, "image": { "file_id": "7603cfad34934e3d83451906bbee6e12", "original_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a5e3849395534d0a9f48790cb3fdfe8d8b82c63e260f4f21bd14f4b5a4f5e7c0", "small_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a5e3849395534d0a9f48790cb3fdfe8d8b82c63e260f4f21bd14f4b5a4f5e7c0-sm.png", "big_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a5e3849395534d0a9f48790cb3fdfe8d8b82c63e260f4f21bd14f4b5a4f5e7c0-md.png" }, "video": { "video_url": "", "original_thumbnail_url": "" } }, { "id": "9c41c86ecb054da2b27cb16bedaa27aa", "landing_page_attachment_type": 1, "image": { "file_id": "4eb83837f6054847a6862e24694fd50a", "original_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/7bb22c5ddc45465cb2e616e81279edc9937638a2085147a88f639d103ba16d0b", "small_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/7bb22c5ddc45465cb2e616e81279edc9937638a2085147a88f639d103ba16d0b-sm.png", "big_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/7bb22c5ddc45465cb2e616e81279edc9937638a2085147a88f639d103ba16d0b-md.png" }, "video": { "video_url": "", "original_thumbnail_url": "" } }, { "id": "512458ae8798436c887a16848dc54fe7", "landing_page_attachment_type": 1, "image": { "file_id": "eaf1883ba0944e538b6a379a0b4f0b2d", "original_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a4c5195e282c4b24a5f9fa43ac8ff28c1b8476da8c5941128eb7aeb8a96f9c66", "small_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a4c5195e282c4b24a5f9fa43ac8ff28c1b8476da8c5941128eb7aeb8a96f9c66-sm.png", "big_url": "https://assets.skool.com/f/463ab648c8674abe9e75cc6b1f2c7685/a4c5195e282c4b24a5f9fa43ac8ff28c1b8476da8c5941128eb7aeb8a96f9c66-md.png" }, "video": { "video_url": "", "original_thumbnail_url": "" } } ], "creator_id": "a9db83e3b6a34420aa73526e5174ffc8", "creator_name": "jordan-fogel-2324", "creator_bio": "Owner of Freedom Team Trading", "creator_last_offline": 1723944076051754000, "creator_link_facebook": "", "creator_link_instagram": "https://www.instagram.com/stocktraderjordan/", "creator_link_linkedin": "", "creator_link_twitter": "https://twitter.com/FT__Trading", "creator_link_website": "", "creator_link_youtube": "https://www.youtube.com/@FT__Trading", "creator_location": "", "creator_myers_briggs": "", "creator_picture_bubble": "https://assets.skool.com/f/a9db83e3b6a34420aa73526e5174ffc8/5f87e730ca8e401a845c53b101ddc9d52ad3bb7d38a443208b4d42e598b3eb45", "creator_picture_profile": "https://assets.skool.com/f/a9db83e3b6a34420aa73526e5174ffc8/5f87e730ca8e401a845c53b101ddc9d52ad3bb7d38a443208b4d42e598b3eb45", "creator_created_at": "2022-12-29T14:43:21.297692Z", "creator_updated_at": "2024-08-18T01:21:16.048372Z", "creator_email": "", "creator_first_name": "Jordan", "creator_last_name": "F", "owner_id": "a9db83e3b6a34420aa73526e5174ffc8", "owner_name": "jordan-fogel-2324", "owner_bio": "Owner of Freedom Team Trading", "owner_last_offline": 1723944076051754000, "owner_link_facebook": "", "owner_link_instagram": "https://www.instagram.com/stocktraderjordan/", "owner_link_linkedin": "", "owner_link_twitter": "https://twitter.com/FT__Trading", "owner_link_website": "", "owner_link_youtube": "https://www.youtube.com/@FT__Trading", "owner_location": "", "owner_myers_briggs": "", "owner_picture_bubble": "https://assets.skool.com/f/a9db83e3b6a34420aa73526e5174ffc8/5f87e730ca8e401a845c53b101ddc9d52ad3bb7d38a443208b4d42e598b3eb45", "owner_picture_profile": "https://assets.skool.com/f/a9db83e3b6a34420aa73526e5174ffc8/5f87e730ca8e401a845c53b101ddc9d52ad3bb7d38a443208b4d42e598b3eb45", "owner_created_at": "2022-12-29T14:43:21.297692Z", "owner_updated_at": "2024-08-18T01:21:16.048372Z", "owner_email": "", "owner_first_name": "Jordan", "owner_last_name": "F" } ## Use Cases - Analyze community growth and engagement on Skool.com - Research competitor groups and their member bases - Identify influencers and active members within specific niches - Track pricing and membership models across different Skool.com communities ## Limitations - Access to member data requires a valid authentication token. - Some groups may be private and inaccessible without proper permissions.