Virtuals.io Scraper

Scrapes detailed agent and token data from Virtuals.io, a platform for virtual tokenomics and ecosystem analytics. Use it to collect information on agent performance, token values, market capitalization, and ascension progress for research or development.

Key Features

• Targeted Scraping: Choose to scrape data for Sentient Agents or Prototype Agents.
• Comprehensive Data: Extracts agent details, tokenomics, market cap calculations, token reserves, and formatted progress data.
• Configurable Execution: Control scraping parameters like concurrency, retries, and delays.
• Reliable Operation: Built-in proxy support for anonymity and request stability.
• Persistent Storage: Use custom dataset names for data deduplication and long-term retention across runs.

How to Use

1. Select Agent Type: In the input, specify either sentient or prototype agents.
2. Configure Input: Set parameters like maxItems and storeName. Adjust performance settings (maxConcurrency, maxRequestRetries) as needed.
3. Run the Actor: Start the run on the Apify platform.
4. Get Results: Download the scraped dataset in JSON, CSV, Excel, or other formats.

Input Configuration

Configure the scraper using a JSON input. Here's a typical example:

{
  "agents": "sentient",
  "maxItems": 10000,
  "maxConcurrency": 10,
  "minConcurrency": 1,
  "maxRequestRetries": 100,
  "storeName": "VirtualsDataStorage",
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Key Input Fields:
* agents: (Required) Agent type. Use "sentient" or "prototype".
* maxItems: Limit for the number of items to scrape.
* maxConcurrency / minConcurrency: Control parallel request limits.
* maxRequestRetries: Number of retries for failed requests.
* storeName: Custom name for the output dataset storage.
* proxy: Configuration for Apify Proxy, recommended for reliable scraping.

Output Structure

The output is a dataset containing a list of agent objects. Each object includes structured data like the example below:

{
  "name": "Bark Ruffalo",
  "role": "CREATIVE",
  "preToken": "0x2D656C595dF8db8526E2F075322ADFcE37F4367d",
  "createdAt": "2024-11-23T14:32:59.403Z",
  "holders": null,
  "marketCap": {
    "rawValue": "592549233513375",
    "formatted": "$2,180,581.2k",
    "isUndergrad": false,
    "preTokenPair": "0x17Ed86287A52987AAD3fB7466699cc73ebE06416",
    "calculationSteps": {
      "originalValue": "592549233513375",
      "baseValue": 592549233513375,
      "supply": 592549.233513375,
      "tokenUsdPrice": 3.68,
      "fdvValue": 2180581.17932922,
      "calculation": "592549233513375 / 1000000000 * 3.68"
    }
  },
  "ascensionProgress": {
    "tokenReserves": 124504236.88581388,
    "virtualReserves": 48191.13108177,
    "progress": 100,
    "formattedProgress": "100.00%"
  }
}

The dataset is available in the Apify platform post-run and can be downloaded in various formats via the Apify API.