Autoscout24 Scraper Lite

# AutoScout24 Scraper Lite A simplified, lightweight scraper for extracting car listings from autoscout24.com. ## Features - Extract car listings from custom search URLs - Control pagination with configurable page limits - Export data in JSON format with detailed vehicle information - Support for multiple search URLs in a single run > Note: This is a lite version focusing on basic scraping functionality. AutoScout24 limits results to maximum 20 pages per search. For larger datasets, split your searches into smaller chunks using different filter combinations in your URLs. --- ## Configuration ### start_urls (required) An array of URL objects containing AutoScout24 search pages to scrape. - Type: Array of objects with url property - Format: Each object must contain a url field with a valid AutoScout24 search URL - Example: json "start_urls": [ { "url": "https://www.autoscout24.com/lst?atype=C&desc=0&sort=standard&source=homepage_search-mask&ustate=N%2CU" } ] How to get search URLs: 1. Go to autoscout24.com 2. Use the search filters (make, model, price range, location, etc.) 3. Copy the URL from your browser's address bar 4. Add it to the start_urls array ### scrape_page_limit (optional) Limits the number of search result pages to scrape from each start URL. - Type: Number - Default: No limit (scrapes all available pages, up to AutoScout24's maximum of 20) - Example: "scrape_page_limit": 1 (scrapes only the first page) - Use case: Useful for testing or when you only need recent listings ### Configuration Examples #### Minimal configuration (scrape all pages) json { "start_urls": [ { "url": "https://www.autoscout24.de/lst?atype=C&cy=D&desc=0&sort=standard&ustate=N%2CU" } ] } #### With page limit (test mode - scrape only first page) json { "start_urls": [ { "url": "https://www.autoscout24.com/lst?atype=C&desc=0&sort=standard&source=homepage_search-mask&ustate=N%2CU" } ], "scrape_page_limit": 1 } #### Multiple search URLs json { "start_urls": [ { "url": "https://www.autoscout24.de/lst?atype=C&cy=D&mmvmk0=9&mmvmd0=48&mmvco=1" }, { "url": "https://www.autoscout24.de/lst?atype=C&cy=D&mmvmk0=74&mmvco=1" } ], "scrape_page_limit": 5 } --- ## Output ### Output Data Structure Each scraped car listing includes detailed information about: - Basic Info: URL, price, make, model, version - Vehicle Details: Type, mileage, registration date, body type, color - Technical Specs: Power (kW/HP), transmission, fuel type, displacement - Features: Comfort, entertainment, safety, and equipment details - Location: Country code, address, coordinates - Seller Info: Type, company name, contact details, phones - Media: Photos array, 3D view, YouTube links - Compliance: Environment ratings (EU standards) ### Simplified Output Example For search result pages, a simplified data structure is also available: json { "url": "/offers/aston-martin-v8-vantage-coupe-gasoline-red-c84c60ba-3e45-4a80-a05e-e69fc05446c1", "price": "119900", "price_formatted": "€ 119,900.-", "old_price": "", "vehicle_type": "Car", "make": "Aston Martin", "model": "V8", "model_version": "Vantage Coupe", "subtitle": null, "offer_type": "U", "vehicle_detail": { "mileage_road": "53,264 km", "transmission": "Automatic", "calendar": "07/2019", "gas_pump": "Gasoline", "speedometer": "375 kW (510 hp)" }, "first_registration": "07-2019", "fuelType": "b", "mileage": "53264", "price_label": "unknown", "country_code": "DE", "location": "Köln, DE, 50968", "seller": { "type": "Dealer", "company_name": "Royal Motors Kempen GmbH", "contact_name": "Carsten Kempen", "listing_url": "/lst?atype=C&cid=23431", "imprint": "https://www.autoscout24.com/dealerinfo/royal-motors-kempen-gmbh/imprint", "phones": [ "Office: +49 (0)221 - 9347800", "Fax: +49 (0)221 - 93478045", "Whatsapp: +49 (0)176 - 70766251" ] } } --- ## Limitations - AutoScout24 limits search results to maximum 20 pages per query - No built-in proxy support in this lite version - Single domain support (autoscout24.com/de/ch/etc.) Workaround for large datasets: Split your searches using different filter combinations: - By price range: €0-10,000, €10,000-20,000, etc. - By location/region - By make/model - By year range --- ## Support If this scraper doesn't match your needs or you encounter issues, please contact: - Email: realspidery@gmail.com - X/Twitter: @realspidery For feature requests or bugs, please provide: - Your input.json configuration - Error messages or logs - Expected vs actual behavior