LM Bench

by artful_sleep

A daily-updated intelligence feed that merges LLM quality (LMArena ELO) and LLM pricing (OpenRouter) into one clean, normalized dataset — so you can ...

21 runs
2 users
Try This Actor

Opens on Apify.com

About LM Bench

A daily-updated intelligence feed that merges LLM quality (LMArena ELO) and LLM pricing (OpenRouter) into one clean, normalized dataset — so you can always choose the best model for your task with best price daily.

What does this actor do?

LM Bench is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

🚀 Daily LLM Intelligence A daily-updated intelligence feed that merges LLM quality (LMArena ELO) and LLM pricing (OpenRouter) into one clean, normalized dataset — so you can always choose the best model for your task. --- ## ❓ What’s the problem? Every AI app says: > “We use the best model for your task.” But in reality, most apps are NOT using the best model: - Many pay 10× more for a model that’s not actually better. - Many use outdated choices because pricing and performance change every week. - Everyone thinks they know which LLM is best — but no one actually tracks it daily. So companies waste money, use wrong models, and miss cheaper or better options. --- ## 🧩 What do we have today? We already have: - Quality data from LMArena (ELO scores) → but it’s not connected to pricing. - Pricing data from OpenRouter → but the model names don’t match. - Many model variants & providers → but no unified naming. So although the data exists, it is fragmented and unusable for real decisions. --- ## ✅ What did I build? I built Daily LLM Intelligence — an Apify Actor that: - ✔ Tracks LLM quality daily (from LMArena) - ✔ Tracks LLM pricing daily (from OpenRouter) - ✔ Normalizes model names (fixes the Qwen / Qwen2.5 / 72B chaos) - ✔ Merges everything into one clean dataset Each row = one canonical model with: - Quality score (ELO) - Price (input / output) - Provider - License - Rank by quality - Rank by price - Value ratio --- ## 🧠 What can users do with it? With this dataset, you can: - Automatically pick the best-value LLM - Avoid overspending - Route traffic to cheapest high-quality models - Build dashboards or alerts - Build an auto model router - Pair it with a recommendation agent It turns LLM selection into a data-driven decision, not guesswork. --- ## ⚙️ How does it work? 1. Fetch LMArena leaderboard 2. Fetch OpenRouter pricing 3. Normalize model names 4. Merge into one clean table 5. Compute basic ranks 6. Output daily dataset Fully automated. --- ## 🧱 What’s inside the Actor? - LMArena scraper - OpenRouter pricing fetcher - Model name normalizer - Merge engine - Rank calculator - Dataset writer Minimal. Stable. Production-oriented. --- ## ⚡ 10-second Version > Most AI apps use the wrong model and waste money. > Quality and pricing change constantly, but no one tracks them daily. > > Daily LLM Intelligence merges real quality + real price + name normalization into one clean dataset — so you can always pick the best model today.

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try LM Bench now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
artful_sleep
Pricing
Paid
Total Runs
21
Active Users
2
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support