PsychologyToday Scraper (Apify Actor) Scrape PsychologyToday listings by category and US state with optional details enrichment. Fast Cheerio parsing for list/profile pages, and Playwright only for opening the PT “website” interstitial and extracting therapist-site emails. --- ## Features - Categories: therapists, psychiatrists, groups, treatment-rehab - Scope: one or many US states, or all states - Modes: List-only or List + Details - Captures on list page: name, title, address, phone, image, profile URL, short description - Captures on details page: - long description - PT website URL (psychologytoday_website) - Therapist website URL (website) - emails from therapist website (cleaned, de-duplicated, params removed, dummy/sentry excluded) - insurance, qualifications - top specialties, expertise, client focus, treatment approach - locations (from .address-line, joined by commas) - Clean, comma-separated list fields (no section headers) > Note: Playwright is used only on the /profile/{id}/website page to click the interstitial “Still here? This way” link and load the therapist’s actual website. --- ## Example Input json { "category": "psychiatrists", "states": ["alabama", "new-jersey"], "scrapeMode": "LIST_AND_DETAILS", "maxItems": 500, "maxPagesPerState": 50, "minDelayMs": 1500, "maxDelayMs": 3000, "proxyConfiguration": { "useApifyProxy": false } } ## Example Output json [{ "name": "John Doe", "title": "Psychiatric Nurse Practitioner, PMHNP-C, FNP-BC", "address": "Online Only", "shortDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options. My goal for you is to know how to proceed. You are not alone; there are quick steps you can take (and includes processing feelings) to start feeling better.", "image": "https://photos.psychologytoday.com/xxxx/3/320x400.jpeg", "detailsUrl": "https://www.psychologytoday.com/us/psychiatrists/xxxx/000000", "phone": "(315) 000-0000", "longDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options. My goal for you is to know how to proceed. You are not alone; there are quick steps you can take (and includes processing feelings) to start feeling better. I run a small practice, and each client receives the time and care they deserve. I tailor my services to each person. And ensure your privacy with no other staff or office clients. Our first session will be in-depth. I'd like the opportunity to work with you. Adler wrote, \"When 'I' is replaced by 'We,' illness becomes wellness\". I'm here and ready to help.", "psychologytoday_website": "https://www.psychologytoday.com/us/profile/000000/website", "website": "https://care.headway.co/providers/john-doe", "emails": "email1@xxx.co,email2@hotmail.com", "insurances": "Aetna,Anthem,Blue Cross,Blue Shield,BlueCross and BlueShield,Cigna and Evernorth,Empire Blue Cross Blue Shield,Quest Behavioral Health", "qualifications": "Verified by Psychology Today License: New York / 401606 Lynn M Hale Education and Years In Practice Upstate Medical University, Syracuse NY, Graduated 2013", "topSpecialties": "Coping Skills,Anxiety,Women's Issues", "expertise": "Coping Skills,Anxiety,Women's Issues,Addiction,Alcohol Use,Bipolar Disorder,Cancer,Chronic Illness,Chronic Pain,Depression,Drug Abuse,Dual Diagnosis,Family Conflict,Geriatric and Seniors,Grief,Life Transitions,Medication Management,Men's Issues,Peer Relationships,Relationship Issues,Self Esteem,Sleep or Insomnia,Stress,Substance Use,Veterans", "clientFocus": "Age Children (6 to 10),Preteen,Teen,Adults,Elders (65+) Participants Individuals Age Children (6 to 10),Preteen,Teen,Adults,Elders (65+) Participants Individuals", "treatmentApproach": "Cognitive Behavioral (CBT),Mindfulness-Based (MBCT),Motivational Interviewing,Person-Centered,Strength-Based", "locations": "La Fayette, NY 13084" }]