Kijiji Crawler The Kijiji crawler is a web scraping tool that allows you to extract data from the Kijiji selling platform. With this crawler, you can get information search results and local advertisement details. The crawler is built on top of Apify SDK, and you can run it both on the Apify platform and locally. ## Features * Scrape data from search pages and advertisements on Kijiji. * Get information about specific page listing. * Collect information about advertisements, including the title, price, images, and description. ## How to use the Kijiji crawler The Kijiji crawler is straightforward to use and doesn't require any coding skills to start using it. Here are the steps to get started: 1. Set up an Apify account if you don't have one already. 2. Create a new task and select the Kijiji crawler. 3. Choose the parameters you want to scrape. 4. Run the task and download the results. ## Input parameters The following table lists the input parameters for this scraper: * startUrls (Array): URLs to fetch data from. * maxPagesToSearch (Integer): When the starting URL is a search page, this parameter will define how many pages to crawl. Default value is 5. * fetchAdsFromSearch (Boolean): Will fetch advertisements details from search pages and store them as individual items when activated. Default value is false. * proxy (Object): Proxy configuration. You can edit this to use Apify proxy, or provide your own proxy servers. Default value is { "useApifyProxy": false }. * debug (Boolean): See detailed logs when activated. Default value is false. ### Input examples Here are the supported URL type: * Search page: Ex. https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/k0c30l1700281?sort=dateDesc&radius=150.0 * Advertisement page: Ex. https://www.kijiji.ca/v-moto-touring/ville-de-montreal/2024-kawasaki-vulcan-s/m7864304 This is an example of how your input will look like if you decide to scrape 2 pages from a search URL and fetching every advertisements found: json { "startUrls": [ "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/k0c30l1700281?sort=dateDesc&radius=150.0" ], "maxPagesToSearch": 2, "fetchAdsFromSearch": true, "proxy": { "useApifyProxy": false }, "debug": false } ### Results example The output from scraping Kijiji is stored in the dataset. Each search page and advertisement is stored as an item inside the dataset. After the run is finished, you can download the scraped data onto your computer or export to any web app in various data formats (JSON, CSV, XML, RSS, HTML Table). Here's a few examples of the outputs you can get for different types of inputs: #### Search result json { "dataType": "search", "pagination": { "page": 1, "pages": 6, "urls": { "first": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/k0c30l1700281?sort=dateDesc&radius=150.0#", "last": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/page-6/k0c30l1700281?radius=150.0&sort=dateDesc", "next": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/page-2/k0c30l1700281?radius=150.0&sort=dateDesc" } }, "total": 240, "results": [ { "dataType": "advertisement", "title": "Kawasaki KLX 300 2024", "price": 8200.00, "description": "Salut je vends mon Kawasaki KLX 300 2024 . Il a 2300 km . Encore comme un neuf et garantie . Plusieurs pièces Neuves ajoutées . Banc Seat Concept Exhaust Delkevic très beau son Handlebar Pro Taper ...", "url": "https://www.kijiji.ca/v-street-cruisers-choppers/ville-de-montreal/kawasaki-klx-300-2024/1687932219", "imageUrl": "https://media.kijiji.ca/api/v1/ca-prod-fsbo-ads/images/41/418e60f7-a37d-413d-b787-85131f9c2eb2?rule=kijijica-200-jpg" }, { "dataType": "advertisement", "title": "2024 Kawasaki Z900 SE", "price": 13594.00, "description": "2024 Kawasaki KLX110R L ------------------------------ 2024 Kawasaki KLX110R L", "url": "https://www.kijiji.ca/v-dirt-bikes-motocross/ville-de-montreal/2024-kawasaki-klx110r-l/m7864396", "imageUrl": "https://media.kijiji.ca/api/v1/autos-prod-ads/images/f3/f36513f2-542d-4c71-9bcd-4cba421ed226?rule=kijijica-200-jpg" }, { "dataType": "advertisement", "title": "2024 Kawasaki KLX110R L", "price": 3544.00, "description": "Salut je vends mon Kawasaki KLX 300 2024 . Il a 2300 km . Encore comme un neuf et garantie . Plusieurs pièces Neuves ajoutées . Banc Seat Concept Exhaust Delkevic très beau son Handlebar Pro Taper ...", "url": "https://www.kijiji.ca/v-street-cruisers-choppers/ville-de-montreal/kawasaki-klx-300-2024/1687932219", "imageUrl": "https://media.kijiji.ca/api/v1/autos-prod-ads/images/74/74d91304-e888-4833-b297-271616af3325?rule=kijijica-200-jpg" }, ... ] } #### Advertisement result json { "dataType": "advertisement", "title": "Kawasaki KLX 300 2024", "url": "https://www.kijiji.ca/v-moto-chopper/ville-de-montreal/kawasaki-klx-300-2024/1687932219", "price": 8200.00, "description": "Salut je vends mon Kawasaki KLX 300 2024. Il a 2300 km. Encore comme un neuf et garantie. Plusieurs pièces Neuves ajoutées.", "seller": { "name": "Boby Desrosiers", "url": "https://www.kijiji.ca/o-profile/31892218/listings/1" }, "images": [ "https://media.kijiji.ca/api/v1/ca-prod-fsbo-ads/images/41/418e60f7-a37d-413d-b787-85131f9c2eb2?rule=kijijica-640-jpg" ] }