Agoda Hotel Scraper An Apify Actor that scrapes hotel data from Agoda.com. Provide a destination, check-in date, and check-out date, and the scraper will extract comprehensive hotel information including prices, ratings, reviews, amenities, and more. ## Features - 🏨 Scrapes hotel listings from Agoda search results - 💰 Extracts pricing information (per night, original price, discounts) - ⭐ Captures star ratings and review scores - 📍 Gets location and address details - 🛏️ Extracts room types and amenities - 🖼️ Collects hotel images and URLs - 📄 Handles pagination and lazy-loaded content ## Input Parameters | Parameter | Type | Required | Default | Description | |-----------|------|----------|---------|-------------| | destination | string | Yes | "Goa" | City or location to search for hotels | | checkInDate | string | Yes | "2025-01-15" | Check-in date in YYYY-MM-DD format | | checkOutDate | string | Yes | "2025-01-17" | Check-out date in YYYY-MM-DD format | | adults | integer | No | 2 | Number of adults (1-10) | | rooms | integer | No | 1 | Number of rooms (1-10) | | maxHotels | integer | No | 50 | Maximum number of hotels to scrape (1-500) | | proxyConfiguration | object | No | - | Proxy settings for anti-bot protection | ### Example Input json { "destination": "Goa", "checkInDate": "2025-01-15", "checkOutDate": "2025-01-17", "adults": 2, "rooms": 1, "maxHotels": 50, "proxyConfiguration": { "useApifyProxy": true } } ## Output Data Each hotel in the output dataset contains the following fields: | Field | Type | Description | |-------|------|-------------| | hotelName | string | Name of the hotel | | location | string | Location/area of the hotel | | rating | number | Star rating (1-5) | | reviewScore | number | Review score (e.g., 8.5/10) | | reviewCount | number | Total number of reviews | | pricePerNight | number | Price per night | | originalPrice | number | Original price (before discount) | | discount | string | Discount percentage | | totalPrice | number | Total price for the stay | | currency | string | Currency code (e.g., "INR") | | roomType | string | Type of room | | amenities | array | List of amenities | | imageUrl | string | URL of hotel image | | hotelUrl | string | Direct link to hotel page | | checkInDate | string | Check-in date | | checkOutDate | string | Check-out date | | destination | string | Search destination | | scrapedAt | string | Timestamp when data was scraped | ### Example Output json { "hotelName": "Taj Exotica Resort & Spa, Goa", "location": "South Goa", "rating": 5, "reviewScore": 9.2, "reviewCount": 1250, "pricePerNight": 25000, "originalPrice": 32000, "discount": "22% off", "totalPrice": 50000, "currency": "INR", "roomType": "Deluxe Room", "amenities": ["Free WiFi", "Pool", "Spa", "Beach Access", "Restaurant"], "imageUrl": "https://example.com/hotel-image.jpg", "hotelUrl": "https://www.agoda.com/en-in/taj-exotica-resort-spa-goa/hotel/...", "checkInDate": "2025-01-15", "checkOutDate": "2025-01-17", "destination": "Goa", "scrapedAt": "2025-01-10T14:30:00.000Z" } ## Running Locally 1. Install dependencies: bash pip install -r requirements.txt playwright install chromium 2. Create input file at storage/key_value_stores/default/INPUT.json: json { "destination": "Mumbai", "checkInDate": "2025-02-01", "checkOutDate": "2025-02-03" } 3. Run the actor: bash apify run ## Deployment to Apify 1. Login to Apify: bash apify login 2. Push to Apify platform: bash apify push ## Technical Details - Framework: Crawlee with Playwright - Browser: Chromium (headless) - Language: Python 3.13 - Anti-bot measures: Uses Apify Proxy, realistic browser fingerprinting ## Notes - The scraper uses Playwright for browser automation since Agoda is a JavaScript-heavy website - Proxy usage is recommended to avoid rate limiting and blocks - Respects Agoda's terms of service - use responsibly - Scraping speed is limited to avoid overloading the server ## License ISC License