GitHub Trending Scraper

Scrapes trending repositories and developers from GitHub in real time. Use it to track fast-growing projects, identify top engineers, or monitor new open-source trends without hitting GitHub API limits.

Overview

This actor extracts structured data from GitHub's "Trending" pages. You can scrape either trending repositories or developers, filtered by date range, programming language, spoken language, and sponsor status. Output is delivered as clean JSON.

Key Features

• Dual Scraping: Collect data for both trending Repositories and Developers.
• Flexible Timeframes: Set the date range to daily, weekly, or monthly trends.
• Targeted Filtering: Filter results by:
  • Programming language (e.g., Python, JavaScript)
  • Spoken language (e.g., English)
  • Sponsor status (true/false to find developers with GitHub Sponsors enabled)
• Structured Output: Returns predictable JSON objects for easy integration.
• No API Limits: Built on web scraping, so it doesn't consume GitHub API rate limits.

How to Use

Configure the actor run with the following input parameters:

• Trending category: Choose Repositories or Developers.
• Date range: Daily, Weekly, or Monthly.
• Code language: (Optional) The programming language to filter by.
• Spoken language: (Optional) The spoken language to filter by (e.g., "English").
• Is Sponsorable: (Optional) true or false to filter developers with sponsorship enabled.

Input / Output

Input Example

A typical configuration to get weekly trending Python repositories would use:

{
  "trendingCategory": "Repositories",
  "dateRange": "Weekly",
  "codeLanguage": "Python"
}

Output Format

The actor returns a list of items. The structure depends on your chosen category.

For Repositories:

{
  "name": "psf / black",
  "description": "The uncompromising Python code formatter",
  "languages": ["Python"],
  "forks": "2,466",
  "stars": "39,053",
  "builders": ["https://github.com/ambv", "..."],
  "date_range_stars": "108"
}

For Developers:

{
  "name": "hoshi-hiyouga",
  "url": "https://github.com/hiyouga",
  "popular_repo": "https://github.com/hiyouga/LLaMA-Factory",
  "popular_repo_description": "Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)"
}

Common Use Cases

• Discovering new, popular open-source projects.
• Identifying influential developers in specific tech stacks.
• Tracking growth metrics (stars, forks) for competitive analysis.
• Building datasets for AI/ML repository research.
• Sourcing potential investment or partnership opportunities in open source.

Support

If you encounter issues or have questions, please share your run details or create an issue to help improve the actor. You can find support through the Apify platform.