Yad2 Real Estate Scraper A robust web scraper for Yad2.co.il (Israel's leading real estate platform) built with Python, Playwright, and Crawlee. Features automatic CAPTCHA solving using AntiCaptcha service. ## Features - 🏠 Comprehensive Scraping: Extracts property listings with price, location, rooms, and description - 🤖 CAPTCHA Solving: Automatic reCAPTCHA solving using AntiCaptcha service - 🌐 Proxy Support: Uses Apify residential proxies with Israel geo-targeting - 🔄 Retry Logic: Intelligent retry mechanism for failed requests - 📊 Structured Data: Exports clean, structured JSON data - 🛡️ Anti-Detection: Browser fingerprint masking and human-like behavior ## Quick Start ### Required Input json { "start_urls": [ "https://www.yad2.co.il/realestate/rent?city=6200", "https://www.yad2.co.il/realestate/forsale?city=5000" ], "anticaptcha_key": "your_anticaptcha_api_key_here" } ### Input Parameters | Parameter | Type | Required | Description | |-----------|------|----------|-------------| | start_urls | Array | ✅ | List of Yad2 URLs to scrape | | anticaptcha_key | String | ❌ | AntiCaptcha API key for CAPTCHA solving | | proxy_country | String | ❌ | Proxy country code (default: "IL") | | headless | Boolean | ❌ | Run in headless mode (default: true) | | max_listings_per_page | Integer | ❌ | Max listings per page (default: 100) | ## Output Format Each scraped listing includes: ```json { "url": "https://www.yad2.co.il/realestate/rent?city=6200", "listing_index": 1, "title": "דירת 3 חדרים בתל אביב", "price": "₪4,500", "address": "תל אבי