Genius Scraper

Overview

This actor scrapes songs and lyrics from Genius.com. It can extract data from song, album, and artist detail pages, tag pages, and search results. You can control the scope of the scrape and choose to include comments.

Key Features

• Song Detail: Extract lyrics and metadata from individual song pages.
• Album Detail: Scrape all songs and lyrics from an album's page.
• Artist Detail: Retrieve an artist's discography and corresponding lyrics.
• Tags: Fetch songs from tag pages (e.g., genres, themes).
• Search: Perform keyword searches on Genius.
• Comments: Optional inclusion of user comments with songs.

How to Use

Provide a JSON input configuration. The scraper can run from startUrls (direct links) or a search query. Proxy configuration is required; you can use your own proxies or Apify Proxy.

For paginated lists (search results, tag pages), use endPage to control depth. Set maxItems to limit the total number of scraped songs.

Performance: The actor is optimized for speed. Under normal conditions, it scrapes ~100 listings in 2 minutes, consuming approximately 0.02-0.04 compute units.

Input/Output

Input (JSON configuration)

{
  "startUrls": ["https://genius.com/Artist-song-lyrics"],
  "search": "(Optional) Search keyword",
  "searchMode": "(Optional) Search type",
  "includeComments": false,
  "endPage": 1,
  "maxItems": 100,
  "proxy": {
    "useApifyProxy": true
  },
  "extendOutputFunction": "(Optional) Custom JS function string",
  "customMapFunction": "(Optional) Custom JS function string"
}

• startUrls: Array of Genius URLs (song, album, artist, or tag pages).
• search & searchMode: Perform a keyword search instead of using startUrls.
• includeComments: Set to true to scrape user comments.
• endPage: The final page number to scrape for paginated results. Default is Infinite.
• maxItems: Hard limit on total items scraped.
• proxy: Required. Proxy configuration object.
• extendOutputFunction & customMapFunction: Optional JavaScript functions (provided as strings) to extend or transform the scraped data.

Tip: To scrape a specific page range from a list, set a startUrl to the first desired page and endPage to the last. For example, a startUrl of page 5 with endPage: 6 will scrape only pages 5 and 6.

Output

The actor outputs a dataset of items, where each item typically represents a song and contains structured data like:
* Song title, URL, and lyrics.
* Artist and album information.
* Metadata from the source page.
* Comments (if includeComments was enabled).

Note: This scraper is under active development. For bug reports or feature requests, create an issue here.