ClearedJobs.Net Scraper Extract security-cleared job listings from ClearedJobs.net with advanced filtering capabilities. This scraper now calls the site’s JSON API first (fast, lightweight), then falls back to HTML/JSON-LD via sitemaps if the API is empty or blocked. ## Key Features - Comprehensive Data Extraction - Captures job titles, company names, locations, security clearance requirements, salaries, job types, posting dates, and full descriptions - Advanced Filtering - Search by keywords, location, and security clearance level - API-First Architecture - Prioritizes JSON API extraction with intelligent HTML fallback for maximum reliability - Full Detail Scraping - Optional deep extraction visits individual job pages for complete information - Smart Pagination - Automatically navigates through multiple pages of results - Proxy Support - Built-in support for Apify Proxy to ensure uninterrupted data collection ## Input Configuration (key fields) - keywords (string): Query terms (e.g., “engineer”, “cyber”). - location / city / state / zip (string): Location filters passed to the API. - remote (string): remote or hybrid to match the site’s remote filters. - sort (string): date (recommended) or relevance. - results_wanted (int): Max jobs to save. - max_pages (int): API pagination safety cap. - startUrls (array): Direct job URLs to force-collect (skips API). - searchUrl (string, optional): Custom /jobs?... page to seed route discovery. - proxyConfiguration (object): Standard Apify proxy settings. ## Output Data Each job listing includes the following fields: json { "title": "Senior Software Engineer", "company": "Lockheed Martin", "location": "Fort Worth, Texas", "security_clearance": "Secret", "salary": "$120,000 - $150,000", "job_type": "Full time", "date_posted": "December 1, 2025", "description_html": "<p>Full HTML description...</p>", "description_text": "Plain text description...", "url": "https://clearedjobs.net/job/..." } ### Output Fields

Field	Type	Description
title	String	Job title
company	String	Employer name
location	String	Job location (city, state)
security_clearance	String	Required security clearance level
salary	String	Salary information (if available)
job_type	String	Employment type (Full time, Part time, Contract, etc.)
date_posted	String	Date the job was posted
description_html	String	Full job description in HTML format
description_text	String	Job description in plain text
url	String	Direct link to job posting

## Usage Examples ### Quick examples json { "keywords": "engineer", "sort": "date", "results_wanted": 25, "max_pages": 4, "remote": "remote", "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } json { "startUrls": [ "https://clearedjobs.net/job/senior-software-engineer-aurora-colorado-1059802" ], "results_wanted": 5 } ## Performance & Best Practices ### Optimization Tips - Use Specific Keywords - Narrow searches return faster and more relevant results - Enable Proxy - Use Apify Proxy (residential) to avoid rate limiting - Adjust collectDetails - Set to false for faster collection when full descriptions aren't needed - Set Reasonable Limits - Use results_wanted and max_pages to control run time and compute units ### Expected Performance

Results	Detail Mode	Estimated Time
20 jobs	Off	30-60 seconds
20 jobs	On	1-2 minutes
50 jobs	Off	1-2 minutes
50 jobs	On	2-3 minutes

Times may vary based on network conditions and proxy performance ## Common Use Cases ### Defense Contractors & Recruiters Find qualified candidates by extracting jobs matching specific clearance levels and technical skills. Export data for talent pipeline management. ### Job Seekers Monitor new postings in your area and skill set. Set up scheduled runs to receive fresh opportunities automatically. ### Market Research Analyze hiring trends in the cleared job market, including salary ranges, in-demand skills, and geographic hotspots. ### Competitive Intelligence Track which companies are hiring, what positions are in demand, and required clearance levels across the industry. ## Troubleshooting ### Common Issues

No results returned

- Check your filter parameters are not too restrictive - Verify the clearance level spelling matches available options - Try broader keywords or remove location filters - Ensure proxy is configured if IP is blocked

Partial data in results

- Enable collectDetails: true for complete information - Some job listings may not include all fields (salary, clearance details) - Check that the scraper completed successfully without errors

Scraper runs slowly

- Reduce results_wanted and max_pages - Use more specific search filters to narrow results - Ensure proxy configuration is optimal (residential recommended) - Set collectDetails: false if full descriptions aren't required

Rate limiting or blocks

- Enable Apify Proxy with residential IPs - Reduce scraping speed by decreasing concurrency in proxy settings - Add delays between requests if running outside Apify platform

## Data Export Options Export your scraped data in multiple formats: - JSON - Structured data for programmatic processing - CSV - Spreadsheet-compatible for analysis in Excel/Google Sheets - Excel - Formatted spreadsheet with headers - HTML - Human-readable table format - XML - For integration with enterprise systems Access exported data via: - Direct download from Apify Console - Apify API endpoints - Webhook notifications - Scheduled delivery to cloud storage ## Legal & Ethical Considerations This scraper is designed for legal data extraction from publicly available job listings. Users are responsible for: - Complying with ClearedJobs.net Terms of Service - Respecting robots.txt and rate limits - Using collected data ethically and legally - Adhering to data privacy regulations (GDPR, CCPA, etc.) - Not using data for spam or unauthorized purposes ## Support & Feedback For issues, questions, or feature requests: - Check the Apify Console logs for detailed error messages - Review this documentation for configuration guidance - Contact support through the Apify platform - Rate and review to help improve this scraper

Built for the Apify platform
Reliable • Scalable • Easy to Use