WebMD Doctor Scraper 👨‍⚕️ Extract comprehensive doctor information from WebMD search results. This actor helps you gather detailed data about healthcare providers, their practices, and patient reviews. ## 🔍 Features - Scrapes detailed doctor profiles including: - Basic information (name, gender, NPI number) - Professional details (specialties, degrees, education) - Practice locations and contact information - Patient ratings and reviews - Insurance acceptance details - Profile photos and videos - Appointment booking links ## 💡 Use Cases - Healthcare provider research and analysis - Medical practice competitive analysis - Patient satisfaction research - Healthcare network development - Insurance network analysis ## 📊 Output The actor outputs JSON data containing detailed information for each doctor, including: - Personal and professional information - Practice locations and contact details - Patient ratings and reviews - Insurance acceptance - Educational background - Profile URLs and booking links ## 🔧 Input Parameters The actor accepts the following input parameters: - searchUrls (Required): Array of WebMD search result URLs to scrape - maxItems (Optional): Maximum number of doctor profiles to scrape - proxyConfiguration (Optional): Proxy settings for making requests ## 💪 Limitations - Only works with WebMD doctor search result pages - Rate limiting may affect scraping speed - Some doctor profiles may have incomplete information ### Input Example A full explanation of an input example in JSON. json { "searchUrls": [ "https://doctor.webmd.com/results?q=heart&d=40&newpatient=false&isvirtualvisit=false&entity=all&gender=all&exp=min_max&hospPromo=false&pt=33.9745,-118.2475&zc=90001&city=Los+Angeles&state=CA" ], "maxItems": 30 } ### Output sample The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. json [ { "searchUrl": "https://doctor.webmd.com/results?q=heart&d=40&newpatient=false&isvirtualvisit=false&entity=all&gender=all&exp=min_max&hospPromo=false&pt=33.9745,-118.2475&zc=90001&city=Los+Angeles&state=CA", "providerid": "E4F63621-2D8F-4AA8-8D9E-3D7AB35FC879", "name": { "first": "Stephanie", "middle": "", "last": "Najarro", "full": "Stephanie Najarro", "suffix": "" }, "gender": "F", "npi": "1376973354", "specialties": [ "Family Medicine", "Internal Medicine", "Primary Care", "Preventative Medicine" ], "degrees": [ "FNP-C" ], "education": { "graduationYear": 2019 }, "photos": { "profile": "https://img.lb.wbmdstatic.com/lhd/provider_prod/2882672_providerprofileimage_e57623f6-6795-4930-bbca-d01f2554100a.png" }, "bio": "<p><b>What makes you passionate about being a healthcare provider?</b><br> I enjoy educating my patients about their health, preventive care, while being able to tailor care to each individual.</p><p><b>In your opinion, what should be the role of a primary care provider for a patient, taking into account both physical health and behavioral health needs?</b><br> Primary care providers are an essential part of the patient's healthcare team. Our goal is to support patient's in their health needs using a comprehensive and holistic approach to ensure their physical and behavioral health needs are supported. </p><p><b>Tell us a little bit about yourself. What do you like to do in your spare time?</b><br> I enjoy spending time with my loved ones and our 3 dogs, exploring new places, trying new food, and reading in front of the fire place or outdoors.</p><p>Patients love Circle Medical because we are a full-service primary care clinic, with over 350 board-certified providers offering easy-to-access care in 26 states. Circle Medical accepts most PPO insurance and Medicare, has no membership fees, and makes it easy to schedule same or next-day appointments that you can attend from anywhere. Our highly trained and friendly staff is accessible via our 4.8/5-star rated app, as well as three clinic locations, with more coming soon.</p><p>Circle medical offers a wide variety of appointment types including Annual Wellness Exams, Sleep Apnea treatment, Gender-Affirming care, Mental Healthcare, ADHD diagnosis and treatment, and much more. Circle Medical provides a safe space for all people to access exceptional quality, evidence-based healthcare. Book your appointment today.</p>", "ratings": { "reviewCount": 11, "averageRating": 5, "categoryRatings": { "c1": 5, "c2": 5, "c3": 5, "c4": 5 } }, "location": { "name": "Circle Medical", "address": "415 N Crescent Dr Ste 320", "city": "Beverly Hills", "state": "CA", "zipcode": "90210", "acceptsNewPatients": true, "acceptsMedicare": true, "acceptsMedicaid": false, "insurances": [ "Aetna_48240_", "Blue Cross Blue Shield of Oklahoma_48335_", "Blue Cross Blue Shield_48310_", "Blue Shield of California_48359_", "CareFirst BlueCross BlueShield_48343_", "Meritain Health_48753_", "Moda Health_48768_", "Moda Health_48768_", "PacificSource Health Plans_48815_", "PacificSource Health Plans_48815_", "PacificSource Health Plans_48815_", "UnitedHealthcare_48957_" ], "coordinates": "34.0966,-118.412", "distance": "12.66" }, "urls": { "profile": "https://doctor.webmd.com/doctor/stephanie-najarro-e4f63621-2d8f-4aa8-8d9e-3d7ab35fc879-overview", "appointment": "https://booking-v2.circlemedical.com/provider/?slug=stephanie-najarro-fnp-c?utm_source=webmd&utm_medium=web&utm_campaign=webmd&utm_id=referral", "website": "https://booking-v2.circlemedical.com/provider/?slug=stephanie-najarro-fnp-c?utm_source=webmd&utm_medium=web&utm_campaign=webmd&utm_id=referral" }, "reviews": [ { "rating": "5", "text": "Very compassionate and kind, Dr. Najarro has a very warm bedside manner. She is very professional and goes above and beyond to ensure quality care in everything she does. I felt very comfortable with her and wouldn’t hesitate to recommend her.", "date": "1/29/2025 12:38:35 PM", "isHighlighted": true }, { "rating": "5", "text": "Very professional and insightful.", "date": "1/25/2024 1:30:13 PM", "isHighlighted": false }, { "rating": "5", "text": "Very professional, kind & understanding. thank you.", "date": "1/24/2024 12:25:47 PM", "isHighlighted": false }, { "rating": "5", "text": "Very thorough! Was very helpful", "date": "1/24/2024 12:24:08 PM", "isHighlighted": false }, { "rating": "5", "text": "Very professional, listens great", "date": "1/23/2024 11:03:21 AM", "isHighlighted": false }, { "rating": "5", "text": "Very thorough. Good listener. Excellent personality.", "date": "1/23/2024 11:02:49 AM", "isHighlighted": false }, { "rating": "5", "text": "Warm, personable, and efficient! she makes care feel like a group project, and makes you feel like she’s on your side!", "date": "1/22/2024 2:27:54 PM", "isHighlighted": false }, { "rating": "5", "text": "what an amazing provider. I’m incredibly impressed with Circle Medical now Just because of her. so much care and attention to detail", "date": "1/22/2024 2:27:23 PM", "isHighlighted": false }, { "rating": "5", "text": "wonderful to work with. great listener and took time to hear all the issues before making a recommendation", "date": "1/19/2024 4:37:13 PM", "isHighlighted": false }, { "rating": "5", "text": "wonderful. professional. thank you.", "date": "1/19/2024 4:36:45 PM", "isHighlighted": false }, { "rating": "5", "text": "you are amazing", "date": "1/19/2024 4:36:16 PM", "isHighlighted": false } ] }, ... ] ## Related Actors - 👨‍⚕️ Practo Doctor Scraper - Extract comprehensive doctor profiles from Practo.com with qualifications and practice details. - 🏥 Netmeds Product Scraper - Scrape detailed medical product information from Netmeds.com with prices and inventory status. - 🔍 Google Search Scraper - Extract up to 5000 search results with flexible search options and language support. - 📊 Email & Contact Extractor From Any Web - Extract emails, phone numbers and social media profiles from any website. - 🎯 Discover & Verify Professional Emails - Find and verify professional email addresses with smart pattern generation. - 🔍 Article Content Extractor - Extract clean article content and metadata from any web page. - 📚 PubMed Search Scraper - Extract research papers and academic articles from PubMed with comprehensive metadata. - 🔍 Google Maps Scraper - Collect up to 5000 place results with detailed business information. - 🏥 Practo Doctor Scraper - Extract detailed healthcare provider information from Practo.com. - 📱 All-in-One Social Media Phone Number Scraper - Extract contact information across 30+ social platforms. - 📧 All-in-One Social Media Email Scraper - Discover emails across 30+ social platforms. - 🔍 URL Metadata Crawler - Extract comprehensive metadata from web pages. - 🌍 Countries Data Scraper - Extract comprehensive country information and geographical data. - 🔍 Keyword Discovery Tool - Discover new keyword ideas and uncover valuable search insights. - 📊 Text Sentiment Analysis - Analyze sentiment of text content with detailed breakdown reports.