Yelp Intelligence Scraper Extract local business data, reviews, ratings, and AI-powered sentiment analysis from Yelp for lead generation, market research, and competitive intelligence. 90% of Yelp users purchase within a week - turn local business data into hot leads. ## Market Opportunity Massive Local Business Intelligence Market - 220+ million reviews on Yelp platform - 90% of users purchase within a week = HOT leads - Company data demand DOUBLED in 2025 - Lead generation market: $40-$300 per qualified lead ## Features - Business Search - Find businesses by category and location - Direct URL Scraping - Extract specific business data by URL - Complete Business Data - Name, rating, reviews, address, phone, website, hours - AI Sentiment Analysis - Automatic positive/neutral/negative classification on reviews - Lead Scoring - Intelligent 0-100 scoring based on rating + reviews + sentiment - Review Extraction - Get customer reviews with detailed metadata - Rating Filters - Filter businesses by minimum/maximum rating - Market Gap Analysis - Identify underserved areas and opportunities ## Use Cases ### Lead Generation ($40-$300/lead market) - Find businesses without websites (15% conversion rate proven) - Identify highly-rated businesses for partnership opportunities - Generate sales leads for B2B services - Build targeted prospect lists by industry and location ### Market Research - Analyze competitor ratings and sentiment trends - Identify market gaps in specific locations - Track category saturation by geography - Monitor review sentiment across competitors ### Competitive Intelligence - Track competitor review counts and ratings over time - Analyze customer feedback patterns - Identify competitor strengths and weaknesses - Monitor price ranges across market ### Local SEO & Marketing - Find businesses with poor online presence - Identify potential clients needing SEO services - Track local market dynamics - Discover trending categories by location ## Input Parameters ### Search Mode | Parameter | Type | Description | Default | |-----------|------|-------------|---------| | searchQuery | string | What to search for (e.g., "pizza", "dentist") | Required | | location | string | City, state, or zip code | Required | | maxBusinesses | integer | Max businesses to extract (1-500) | 50 | | maxReviewsPerBusiness | integer | Max reviews per business (0-100) | 20 | | minRating | number | Filter businesses >= rating (1.0-5.0) | - | | maxRating | number | Filter businesses <= rating (1.0-5.0) | - | | includeSentiment | boolean | Add AI sentiment analysis | true | | includeLeadScore | boolean | Calculate lead quality score | true | ### Direct URLs Mode | Parameter | Type | Description | |-----------|------|-------------| | businessUrls | array | Direct Yelp business URLs to scrape | ## Output Example json { "url": "https://www.yelp.com/biz/tonys-pizza-san-francisco", "scraped_at": "2025-11-13T12:00:00.000000", "business_name": "Tony's Pizza Napoletana", "rating": 4.5, "review_count": 5234, "category": "Pizza, Italian, Bars", "address": "1570 Stockton St, San Francisco, CA 94133", "phone": "(415) 835-9888", "website": "https://www.tonyspizzanapoletana.com", "hours": { "Monday": "Closed", "Tuesday": "5:00 PM - 10:00 PM", "Wednesday": "5:00 PM - 10:00 PM" }, "price_range": "$$", "lead_score": 85, "reviews_count": 20, "reviews": [ { "rating": 5, "text": "Amazing pizza! The margherita is perfect - crispy crust, fresh ingredients, authentic Italian taste. Highly recommend!", "date": "11/12/2025", "reviewer_name": "Sarah M.", "reviewer_location": "San Francisco, CA", "sentiment": "positive" }, { "rating": 2, "text": "Long wait times and the service was slow. Pizza was okay but not worth the hype.", "date": "11/10/2025", "reviewer_name": "Mike D.", "reviewer_location": "Oakland, CA", "sentiment": "negative" } ] } ## Data Fields ### Business Data - business_name - Business name - rating - Average star rating (1.0-5.0) - review_count - Total number of reviews - category - Business categories (comma-separated) - address - Full street address - phone - Contact phone number - website - Business website URL - hours - Operating hours by day - price_range - Price indicator ($, $$, $$$, $$$$) - lead_score - Quality score 0-100 (if enabled) ### Review Data - rating - Star rating (1-5) - text - Full review text - date - Review date - reviewer_name - Customer name - reviewer_location - Customer location - sentiment - AI classification (positive/neutral/negative) ## Lead Score Calculation The lead score (0-100) combines three factors: - Rating (40 points): Higher rating = better quality business - Review Count (30 points): More reviews = established business with social proof - 1-10 reviews: 10 points - 11-50 reviews: 20 points - 51+ reviews: 30 points - Sentiment (30 points): Positive review percentage from recent reviews Example Scores: - 95-100: Excellent lead (5-star rating, 100+ reviews, 90%+ positive sentiment) - 80-94: High-quality lead (4.5+ stars, 50+ reviews, 80%+ positive) - 60-79: Good lead (4+ stars, 20+ reviews, 70%+ positive) - 40-59: Moderate lead (3+ stars, 10+ reviews) - 0-39: Low-quality lead ## Pricing Pay-Per-Result (PPR) - Recommended - $0.025 per business ($25 per 1,000 businesses) - Includes: Full business data + reviews + sentiment + lead scoring - Perfect for B2B lead generation and market research Market Context: - Lead generation tools: $99-$500/month - Qualified B2B leads: $40-$300 each - Market intelligence platforms: $1,000-$5,000/month - 90% of Yelp users purchase within a week = premium lead quality Cost Examples: - 50 businesses = $1.25 - 100 businesses = $2.50 - 500 businesses = $12.50 - 1,000 businesses = $25.00 ## Real-World Success Story Marketing Agency in San Diego: - Searched for businesses with 50+ reviews but no website - Got 15% response rate for website services - Generated new projects from local business leads ## Technical Details ### Architecture - Browser-Based - Uses Playwright for reliable JavaScript rendering - Intelligent Parsing - Extracts data from Yelp's dynamic content - AI Sentiment Analysis - Rule-based classification with keyword detection - Lead Scoring Algorithm - Multi-factor scoring for lead qualification - Error Handling - Graceful fallbacks and retry logic ### Performance - Speed - ~3-5 seconds per business page - Reliability - Playwright handles dynamic content - Scale - Can process hundreds of businesses per run - Accuracy - Direct DOM extraction for high data quality ## Legal & Compliance - Extracts publicly available data only - Respects Yelp's terms of service - For commercial use, ensure compliance with data protection laws - Do not use for spam, harassment, or malicious purposes - Use for legitimate business intelligence and research ## Limitations 1. Rate Limiting - Yelp may block excessive requests from same IP 2. Dynamic Content - Layout changes may require actor updates 3. Review Pagination - Limited to displayed reviews (typically 100 per business) 4. Search Results - Yelp limits search results to ~240 businesses per query ## Tips for Best Results ### Lead Generation - Filter by rating (4.0+) for quality prospects - Look for businesses with 20-50 reviews (established but still growing) - Target categories with high customer LTV (dentists, lawyers, contractors) - Use lead score to prioritize outreach ### Market Research - Compare competitors in same location + category - Track sentiment trends across similar businesses - Identify underserved categories (low business count) - Monitor review count growth as market indicator ### Competitive Intelligence - Track top-rated competitors regularly - Analyze review sentiment patterns - Identify common customer complaints - Monitor new businesses entering market ### Search Optimization - Use specific categories for better targeting ("dentist" vs "healthcare") - Try zip codes for hyper-local searches - Combine multiple searches to cover broader areas - Use rating filters to focus on quality or opportunity ## Support For issues, questions, or feature requests, contact the developer or submit an issue on GitHub. ## Changelog ### Version 1.0 (2025-11-13) - Initial release - Business search by location and category - Direct URL scraping - AI-powered sentiment analysis - Intelligent lead scoring (0-100) - Review extraction with metadata - Rating filters - Complete business data extraction