Workday Job Scraper ## Description This Apify actor efficiently scrapes job listings from Workday-powered career portals. It extracts comprehensive job data including titles, locations, descriptions, and application links from Workday's job search APIs. The actor handles pagination automatically and provides flexible configuration for targeted job searches. ## Features - Comprehensive Data Extraction: Captures all key job details from Workday APIs - Automatic Pagination: Handles multi-page results seamlessly - Flexible Filtering: Supports keyword, location, and category-based searches - Proxy Support: Built-in proxy rotation for reliable scraping - Dataset Integration: Saves results directly to Apify datasets - Error Handling: Robust retry mechanisms and session management ## Input ### Required Parameters - startUrl (string): The Workday API endpoint URL to start scraping from (e.g., https://company.wd1.myworkdayjobs.com/wday/cxs/company/site/jobs) ### Optional Parameters - keyword (string): Job search keywords (e.g., "software engineer", "data analyst") - location (string): Geographic location filter - category (string): Job category filter - results_wanted (integer): Maximum number of jobs to collect (default: 100) - max_pages (integer): Maximum pages to scrape (default: 999) - collectDetails (boolean): Whether to collect full job data or just URLs (default: true) - proxyConfiguration: Proxy settings for enhanced reliability ## Output The actor outputs structured job data to an Apify dataset with the following schema: json { "title": "Job Title", "company": "Company Name", "category": "Job Category", "location": "Job Location", "date_posted": "Posting Date", "job_type": "Employment Type", "description_html": "<p>Full job description in HTML</p>", "description_text": "Plain text job description", "job_url": "https://company.wd1.myworkdayjobs.com/job/..." } ## Usage ### Basic Usage 1. Set the Start URL: Provide the Workday API endpoint for the company you want to scrape 2. Configure Filters: Add keywords, location, or category to narrow results 3. Run the Actor: Execute on Apify platform or locally 4. Access Results: Download the dataset in JSON, CSV, or other formats ### Example Input json { "startUrl": "https://workday.wd5.myworkdayjobs.com/wday/cxs/workday/Workday/jobs", "keyword": "software engineer", "location": "San Francisco", "results_wanted": 50 } ### Advanced Configuration For large-scale scraping: - Use residential proxies for better success rates - Set reasonable results_wanted limits to avoid timeouts - Enable collectDetails for complete job information ## Configuration ### Proxy Settings json { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ### Performance Tuning - Concurrency: Adjust based on target site rate limits - Delays: Built-in delays prevent blocking - Retries: Automatic retry on failures ## Limits & Considerations - Rate Limiting: Respects target site limits with built-in delays - Data Freshness: Results reflect current job postings - API Changes: Workday may update their API structure - Geographic Restrictions: Some jobs may have location restrictions ## Cost Optimization - Use targeted searches to reduce runtime - Set appropriate results_wanted limits - Choose cost-effective proxy options ## Support For issues or questions: - Check the input parameters match your target Workday site - Verify the API endpoint URL is correct - Ensure proxy configuration is enabled for production use