Indeed Jobs Scraper

An Apify actor that scrapes structured job listings from Indeed based on search terms and location. It's designed for job market research, recruitment analysis, and tracking hiring trends.

Overview

This actor automates the collection of job postings from Indeed.com. You provide search criteria like job title and location, and it returns a dataset containing detailed information for each listing, including company, salary, description, and job type. It handles proxy rotation to avoid blocks and can process dynamic content.

Key Features

• Structured Data Extraction: Pulls job title, company, location, salary (with min/max values), job description, experience level, posting date, and more.
• Configurable Search: Filter by job type (full-time, part-time, etc.), experience level, remote work, and salary range.
• Scalable Operation: Uses Apify Proxy with residential IPs by default to prevent IP bans and access location-specific results.
• Flexible Output: Results are available in JSON, CSV, or Excel formats via the Apify dataset.
• Robust Tech Stack: Built on Apify SDK and Crawlee with Puppeteer for reliable scraping, including JavaScript-rendered pages.

How to Use

1. Open the actor in the Apify Console.
2. Click "Try actor" or create a new task.
3. Configure your input parameters (see below).
4. Run the actor.
5. Download the results from the dataset tab in your preferred format.

Input Configuration

Configure the actor using a JSON input. Only search and location are strictly required.

{
  "search": "software engineer",
  "location": "New York",
  "jobType": "fulltime",
  "experienceLevel": "entry_level",
  "remote": false,
  "maxItems": 100,
  "startUrls": [],
  "debugMode": false
}

Key Input Fields:
* search (string): Job title or keywords (e.g., "data scientist").
* location (string): Geographic search area (e.g., "San Francisco").
* jobType (string, optional): fulltime, parttime, contract, internship.
* experienceLevel (string, optional): entry_level, mid_level, senior_level.
* remote (boolean, optional): Set to true to include remote jobs.
* maxItems (number, optional): Limit the total number of jobs scraped.
* startUrls (array, optional): Provide specific Indeed URLs to scrape, overriding the search and location fields.

Proxy & Advanced Settings:
The actor automatically uses Apify Proxy. For advanced control, you can specify a proxyConfiguration object. Other optional parameters like maxConcurrency, minDelayBetweenRequestsMs, and maxRequestRetries help manage request rate and reliability.

Output

The actor outputs an array of job objects to an Apify dataset. Each job contains structured fields.

Example Output Item:

{
  "jobTitle": "Senior Software Engineer",
  "companyName": "Tech Corp Inc.",
  "location": "New York, NY",
  "salary": "$120,000 - $160,000 a year",
  "salaryMin": "120000",
  "salaryMax": "160000",
  "jobDescription": "We are looking for a senior software engineer...",
  "jobType": "fulltime",
  "experienceLevel": "senior_level",
  "postedDate": "2024-01-15",
  "isRemote": false,
  "jobUrl": "https://www.indeed.com/viewjob?jk=1234567890abcdef",
  "scrapedAt": "2024-01-15T10:30:00.000Z"
}

Core Output Fields Include: jobTitle, companyName, location, salaryMin, salaryMax, jobDescription, jobType, experienceLevel, postedDate, isRemote, jobUrl, and a timestamp (scrapedAt).