Github List Scraper

by janbuchar

This Actor scrapes repositories from GitHub **Awesome Lists**, **topic listings**, and **individual repositories**, collecting useful metadata for eac...

447 runs
27 users
Try This Actor

Opens on Apify.com

About Github List Scraper

This Actor scrapes repositories from GitHub **Awesome Lists**, **topic listings**, and **individual repositories**, collecting useful metadata for each project.

What does this actor do?

Github List Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

GitHub Awesome List and topic scraper ## What this Actor does This Actor scrapes repositories from GitHub Awesome Lists, topic listings, and individual repositories, collecting useful metadata for each project. ## Input parameters You can customize the scraping by providing on or more of these fields: json { "awesomeLists": ["owner/repository"], "topics": ["example-topic"], "repositories": ["owner/repository"] } - awesomeLists (array, optional) – List of GitHub Awesome Lists to scrape. - topics (array, optional) – Fetch all repositories with these topics. - repositories (array, optional) – Scrape specific repositories. ## Output format The Actor outputs a dataset with the following fields: json [ { "repository": "octocat/Hello-World", "description": "An example repo", "homepageUrl": "https://example.com", "tocPath": ["Awesome examples", "Repository examples"], "topics": ["opensource", "example"], "latestCommit": "2024-03-01T12:34:56Z", "stars": 1234, "readmeContent": "This is the README content..." } ]

Categories

OPEN_SOURCE SOCIAL_MEDIA DEVELOPER_TOOLS

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try Github List Scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
janbuchar
Pricing
Paid
Total Runs
447
Active Users
27

Related Actors

Web Scraper

Web Scraper

by apify

 Cheerio Scraper

Cheerio Scraper

by apify

 Legacy PhantomJS Crawler

Legacy PhantomJS Crawler

by apify

 Content Checker

Content Checker

by jakubbalada
Browse All Actors
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support