Medium Scraper

Medium Scraper

by ivanvs

Scrape data such as authors, titles, applause, responses and publication dates from the Medium blogging platform. Download listings data in JSON, XML,...

2,596 runs
270 users
Try This Actor

Opens on Apify.com

About Medium Scraper

Scrape data such as authors, titles, applause, responses and publication dates from the Medium blogging platform. Download listings data in JSON, XML, Excel, and other versatile

What does this actor do?

Medium Scraper is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

Medium Scraper Scrape data from Medium easily with Medium Scraper. ## About Medium is an American online publishing platform developed by Evan Williams and launched in August 2012. It is owned by A Medium Corporation. The platform is an example of social journalism, having a hybrid collection of amateur and professional people and publications, or exclusive blogs or publishers on Medium and is regularly regarded as a blog host. ## How to use? In order to use Medium Scraper you need to provide tag for which you want to scrape blog posts on Medium and optionaly month or year. If year and month are not supplied, we will scrape the most popular post for given tag and date info. So if only year is supplied, the most popular posts from given year will be scraped. If year and month is supplied, the most popular posts for given year and month will be scraped. ## How to find valid tags? Finding Related Tags on Medium.com 1. Go to Medium.com. 2. Use the search bar at the top of the page. 3. Type in the topic you're interested in (e.g., "artificial intelligence," "writing tips," "healthy eating"). 4. After the search results appear, click on the "Topics" tab. 5. This tab will show you various tags and related subjects that are connected to your search term. These are the most relevant tags that Medium users are applying to content on that topic. Medium.com tags search ### Example Scrape the most popular posts for tag java of all time order by oldest first json { "tag": "java", "orderBy": "most-read" } Scrape the most popular posts for tag java in 2020 json { "tag": "java", "year": 2020, "orderBy": "most-read" } Scrape the most popular posts for tag java in January 2020 json { "tag": "java", "year": 2020, "month": 1, "orderBy": "most-read" } Only dates in past are valid! ### Output Here is example of a scraped article: json { "id": "33189ab03f60", "title": "I Asked ChatGPT How To Earn $1000 Online. It Was Hilarious.", "image": "https://miro.medium.com/v2/resize:fit:700/1*Y-qcUstemdW57V54aNWnnQ.jpeg", "subtitle": "Peering in the hive mind can be really helpful, but it can also be so stupid it’s funny", "author": { "id": "d5700e8fad77", "name": "Linda Caroll", "url": "https://medium.com/@lindacaroll", "username": "lindacaroll", "image": "https://miro.medium.com/v2/resize:fill:20:20/2*k9WGjFrkNI3f-kD5wjRxlQ.jpeg", "bio": "Everything is storytelling. https://lindac.substack.com/" }, "url": "https://medium.com/the-partnered-pen/i-asked-chatgpt-how-to-earn-1000-online-it-was-hilarious-33189ab03f60", "responses": 540, "readingTime": 5.403773584905661, "publication": { "name": "The Partnered Pen", "url": "https://medium.com/the-partnered-pen", "image": "https://miro.medium.com/v2/resize:fill:20:20/1*N17wOF_ZH_k7MbDnwogDPQ.png", "domain": null }, "aplause": 25220, "isMemberOnlyStory": true, "content": [ "I Asked ChatGPT How To Earn $1000 Online. It Was Hilarious.", "Peering in the hive mind can be really helpful, but it can also be so stupid it’s funny..." ], "tags": ["ChatGPT", "Make Money Online", "Entrepreneur", "Work From Home", "Internet Marketing"], "publishingDate": "3/24/2023 7:51:42 AM", "wordCount": 1061, "seo": { "title": "", "description": "" } } ## Medium Scraper data output The output from Medium Scraper is stored in the dataset. After the run is finished, you can download the dataset in various data formats (JSON, CSV, XML, RSS, HTML Table). ## How much does it cost to scrape Medium Scraper? Running Medium Scraper once will get you 1,000 results for less than $2 in Apify platform credits. For more details about the plans offer, platform credits, and usage, see the platform pricing page. ## ❓FAQ ### Do I need proxies to scrape Medium.com? Proxy for this scraper is already preconfigured for optimal performance. ## Support For more custom/simplify outputs or Bug report please contact the developer (me) or report an issue. If you have feature request you can send suggestion here.

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try Medium Scraper now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
ivanvs
Pricing
Paid
Total Runs
2,596
Active Users
270
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support