Xueqiu User Posts Scraper

Overview

This actor scrapes posts and metadata from user profiles on Xueqiu.com, a major Chinese financial social network. It automates the collection of investment discussions, stock analysis, and user engagement data for financial research and market sentiment analysis.

Key Features

• Extracts over 80 data fields per post, including full text, timestamps, and attached media links.
• Captures engagement metrics: likes, retweets, comments, and view counts.
• Identifies and extracts mentioned stock symbols and financial instruments.
• Targets specific user profiles via their profile URLs.
• Configurable limits on posts per profile and retry logic for reliability.

How to Use

Configure the actor using a JSON input. The core requirement is providing an array of Xueqiu user profile URLs. Using Apify Proxy is recommended to avoid bot detection.

Input/Output

Input Configuration (JSON):

{
  "max_retries_per_url": 2,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "SG"
  },
  "max_items_per_url": 20,
  "urls": [
    "https://xueqiu.com/u/5355205180",
    "https://xueqiu.com/u/5584866422"
  ]
}

Parameters:
* urls: (Required) Array of target user profile URLs (e.g., https://xueqiu.com/u/123456).
* max_items_per_url: Maximum number of posts to scrape per profile.
* max_retries_per_url: Retry attempts for failed page access.
* proxy: Configure useApifyProxy: true with residential proxy groups. Set apifyProxyCountry to match your target data region (e.g., SG for Singapore).

Output:
The actor outputs a dataset of items, each representing a scraped post. Each item includes fields such as:
* text: The full post content.
* post_id, created_at, user_id, user_name.
* Engagement counts: likes, retweets, comments, views.
* symbols: Array of stock symbols mentioned in the post.
* pics/video: Arrays of media URLs attached to the post.

For issues, contact the developer via My profile.