TrueAchievements Scraper

This Apify actor scrapes data from TrueAchievements.com, providing an alternative to its limited free API. It extracts game details, articles, lists, and search results.

Key Features

The scraper supports several data retrieval methods:
* Search: Find games, articles, and comments by keyword.
* List Scraping: Extract data from article lists, game lists (including full Xbox catalog), Xbox Game Pass lists, genres, and publisher pages.
* Detail Scraping: Get comprehensive data for individual games (images, achievements, developers, genres, publishers) and full articles with comments.
* Series & Publisher Data: Retrieve all games belonging to a specific series or publisher.

How to Use

Configure the actor using a JSON input. The scraper is optimized for speed and can scrape approximately 100 data points in 2 minutes, consuming ~0.06-0.09 compute units.

Input Parameters

Provide input as a JSON object with the following fields:

• search: (Optional, String) A keyword to search on TrueAchievements.
• startUrls: (Optional, Array) A list of TrueAchievements URLs to scrape. Accepts news lists, search results, listing pages, game/article details, genre pages, and publisher pages.
• includeComments: (Optional, Boolean) When set to true, includes all comments in article detail outputs. Increases time and resource usage.
• endPage: (Optional, Number) The final page number to scrape for search requests and paginated startUrls. Default is to scrape all pages (Infinite).
• maxItems: (Optional, Number) A limit for the total number of items to scrape from lists or search results.
• proxy: (Required, Proxy Object) Proxy configuration. Proxy servers are required. You can use your own or Apify Proxy.
• extendOutputFunction: (Optional, String) A custom JavaScript function that takes a JQuery handle ($) as an argument and returns an object to extend the output.
• customMapFunction: (Optional, String) A custom JavaScript function that takes each object's handle as an argument and returns a modified object.

Tip: To scrape a specific list, paste its URL into startUrls. Control pagination by combining the starting page URL with the endPage parameter. For example, providing page 5's URL with "endPage": 6 will scrape only pages 5 and 6.

Input Example

{
  "startUrls": [
    "https://www.trueachievements.com/news?search=game",
    "https://www.trueachievements.com/game/Monster-Energy-Supercross-4",
    "https://www.trueachievements.com/series/Call-of-Duty",
    "https://www.trueachievements.com/publisher/Electronic-Arts/"
  ],
  "includeComments": false,
  "maxItems": 50,
  "proxy": {
    "useApifyProxy": true
  }
}

Output

The actor outputs items to the dataset, with the structure varying by the type of page scraped (e.g., game detail, article list item, search result). Each record contains the extracted data fields from the target page.

Development & Support

This scraper is under active development. For bug reports or feature requests, please create an issue on the GitHub repository.