Answer the Public Scraper Extract comprehensive keyword research data from AnswerThePublic.com]for any keyword. Get search insights from multiple sources including Google, Bing, YouTube, TikTok, Instagram, Amazon, and ChatGPT. Want to learn more? Check out the comprehensive docs site here: https://withseismic.com/apify-actors/answer-the-public ## What data can you extract? This actor retrieves comprehensive keyword research data from Answer the Public across multiple platforms: ### Data Sources - Search Engines: Google Web, Bing - Social Media: YouTube, TikTok, Instagram - E-commerce: Amazon - AI Platforms: ChatGPT ### Metrics & Insights - Related search queries and questions - Search volume estimates - Cost per click (CPC) data - Trending topics and comparisons - Question-based searches (who, what, when, where, why, how) - Preposition-based searches (for, with, to, near, etc.) Perfect for SEO research, content planning, market research, and competitive analysis. ## Why use this actor? Answer the Public limits free accounts to 3 searches per day. This actor provides programmatic access to the same free-tier data without daily search limits, making it ideal for: - Bulk keyword research across hundreds or thousands of terms - Automated SEO workflows and content pipelines - Regular competitive monitoring and trend analysis - Building keyword databases without manual daily searches Note: This actor returns the same data available to free Answer the Public accounts. For premium features like alphabetical lists and extended data, you would need an Answer the Public subscription. ## Features - Extract data for multiple keywords in a single run - Support for different languages and regions - Comprehensive data from 7+ different sources - Automatic handling of search completion - Clean, structured JSON output - No daily search limits ## Input The actor accepts the following input parameters: | Field | Type | Required | Default | Description | |-------|------|----------|---------|-------------| | keywords | Array | Yes | - | List of keywords to research | | language | String | No | "en" | Language code (e.g., 'en', 'es', 'fr') | | region | String | No | "us" | Region code (e.g., 'us', 'uk', 'ca') | | maxPollAttempts | Number | No | 60 | Maximum attempts to wait for results | | pollInterval | Number | No | 5000 | Time between checks in milliseconds | ### Input Example json { "keywords": ["james bond", "coffee beans", "yoga mat"], "language": "en", "region": "us" } ## Output The actor stores results in the default dataset. Each item contains: | Field | Type | Description | |-------|------|-------------| | keyword | String | The searched keyword | | language | String | Language used for search | | region | String | Region used for search | | parentSearchId | String | Unique search identifier | | data | Object | Complete search results organized by category | | completedAt | String | ISO timestamp of completion | ### Output Structure Results are organized into four main categories: #### 1. Search Engines - Google Web (gweb) - Bing (bing) #### 2. Social Media - YouTube (youtube) - TikTok (tiktok) - Instagram (instagram) #### 3. Shopping - Amazon (amazon) #### 4. AI - ChatGPT (chatgpt) Each source provides: - Completion status - Whether the search has finished - Search results data - Array of related queries, questions, and topics - Result counts - Total number of results found - Search volume metrics - Estimated monthly search volume - Cost per click estimates - Average CPC for paid advertising - Pagination info - Page number, total pages, results per page ### What's Inside the Results? Each platform returns different types of data: Search Engines (Google, Bing) - Question-based queries (Who, What, When, Where, Why, How) - Preposition-based queries (for, with, to, near, etc.) - Comparison queries (vs, versus, or, and) - Related search terms - Alphabetical query variations Social Media (YouTube, TikTok, Instagram) - Trending video topics - Popular hashtags - Content creator suggestions - Related channels/accounts E-commerce (Amazon) - Product search queries - Shopping-related questions - Product comparison terms AI (ChatGPT) - Common prompts and questions - Related conversation topics ### Output Example json { "keyword": "james bond", "language": "en", "region": "us", "parentSearchId": "abc123", "completedAt": "2025-11-17T00:45:30.000Z", "data": { "search_engine": { "gweb": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 150 }, "bing": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 120 } }, "social_media": { "youtube": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 85 }, "tiktok": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 45 }, "instagram": { "completed": true, "status": "completed", "results": { "data": { "hashtags": [], "people": [] }, "page_info": {...} }, "total_results_count": 0 } }, "shopping": { "amazon": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 95 } }, "ai": { "chatgpt": { "completed": true, "status": "completed", "results": { "data": [...], "page_info": {...} }, "total_results_count": 60 } }, "max_search_volume": 201000, "max_cost_per_click": 34.735 } } ## How to Use ### Using the Apify Console 1. Navigate to the actor's page 2. Click "Try for free" 3. Enter your keywords and configuration 4. Click "Start" and wait for results 5. Download data as JSON, CSV, or Excel ### Using the Apify API (JavaScript/Node.js) javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN', }); const input = { keywords: ["sustainable fashion", "eco friendly products", "vegan leather"], language: "en", region: "us" }; // Start the actor and wait for it to finish const run = await client.actor("YOUR_ACTOR_ID").call(input); // Fetch results from the dataset const { items } = await client.dataset(run.defaultDatasetId).listItems(); // Process the results items.forEach((item) => { console.log(`\n=== ${item.keyword} ===`); console.log(`Search Volume: ${item.data.max_search_volume}`); console.log(`Max CPC: $${item.data.max_cost_per_click}`); // Access Google search data const googleData = item.data.search_engine.gweb; console.log(`Google results: ${googleData.total_results_count}`); // Access YouTube data const youtubeData = item.data.social_media.youtube; console.log(`YouTube results: ${youtubeData.total_results_count}`); }); ### Using Python python from apify_client import ApifyClient client = ApifyClient('YOUR_APIFY_TOKEN') # Prepare input run_input = { "keywords": ["sustainable fashion", "eco friendly products"], "language": "en", "region": "us" } # Run the actor and wait for it to finish run = client.actor("YOUR_ACTOR_ID").call(run_input=run_input) # Fetch results for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(f"Keyword: {item['keyword']}") print(f"Search Volume: {item['data']['max_search_volume']}") print(f"CPC: ${item['data']['max_cost_per_click']}") ### Using Apify CLI bash # Run the actor apify call YOUR_ACTOR_ID --input '{ "keywords": ["digital marketing", "seo tools"], "language": "en", "region": "us" }' # Download results as JSON apify dataset download ### Using cURL (REST API) bash curl -X POST https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs \ -H 'Content-Type: application/json' \ -H 'Authorization: Bearer YOUR_APIFY_TOKEN' \ -d '{ "keywords": ["keyword research"], "language": "en", "region": "us" }' ### Working with the Data Once you have the results, you can access specific data points: javascript // Access search engine data const googleResults = item.data.search_engine.gweb.results.data; const bingResults = item.data.search_engine.bing.results.data; // Access social media insights const youtubeResults = item.data.social_media.youtube.results.data; const tiktokResults = item.data.social_media.tiktok.results.data; const instagramHashtags = item.data.social_media.instagram.results.data.hashtags; // Access e-commerce data const amazonResults = item.data.shopping.amazon.results.data; // Access AI platform data const chatGPTResults = item.data.ai.chatgpt.results.data; // Get key metrics const searchVolume = item.data.max_search_volume; const costPerClick = item.data.max_cost_per_click; ### Export Formats Results can be exported in multiple formats from the Apify platform: - JSON - Full structured data with all fields - CSV - Flattened data suitable for spreadsheets - Excel - Formatted spreadsheet with data - HTML Table - Web-ready table format - RSS Feed - Automated updates via RSS ### Integration with Make/Zapier This actor integrates seamlessly with automation platforms: - Make (Integromat): Build automated workflows - Zapier: Connect to 5,000+ apps - Google Sheets: Automatically populate keyword research data - Airtable: Build keyword research databases - Slack/Discord: Get notifications when research completes - Webhooks: Send data to custom endpoints Example use cases: - Monitor keyword trends daily and send reports via email - Build automated content calendars based on trending queries - Trigger competitor analysis when new keywords emerge - Populate CRM with market research data ## Use Cases - SEO Research: Discover popular search queries and related keywords - Content Planning: Find trending topics and questions people ask - Market Research: Understand what people are searching for in your niche - Competitor Analysis: Research keywords your competitors might be targeting - PPC Campaigns: Get cost per click estimates for keyword planning - Social Media Strategy: Discover trending topics across platforms ## Advanced Features ### Webhooks Get notified when your actor run completes: javascript const run = await client.actor("YOUR_ACTOR_ID").call(input, { webhooks: [{ eventTypes: ['ACTOR.RUN.SUCCEEDED'], requestUrl: 'https://your-webhook-url.com/webhook' }] }); ### Scheduled Runs Set up recurring keyword research: 1. Go to the actor's page on Apify 2. Click "Schedule" 3. Configure frequency (hourly, daily, weekly) 4. Set your input parameters 5. Actor runs automatically on schedule ### API Access to Results Access your data via Apify's REST API: bash # Get dataset items curl https://api.apify.com/v2/datasets/YOUR_DATASET_ID/items \ -H 'Authorization: Bearer YOUR_APIFY_TOKEN' # Get specific fields only curl "https://api.apify.com/v2/datasets/YOUR_DATASET_ID/items?fields=keyword,data.max_search_volume" \ -H 'Authorization: Bearer YOUR_APIFY_TOKEN' # Export as CSV curl "https://api.apify.com/v2/datasets/YOUR_DATASET_ID/items?format=csv" \ -H 'Authorization: Bearer YOUR_APIFY_TOKEN' ## Performance - Processes each keyword in approximately 30-60 seconds - Handles multiple keywords sequentially - Automatic retry logic for failed searches - Reliable data extraction - Results stored in Apify dataset for easy access ## Support If you encounter any issues or have questions, please open an issue or visit the Apify documentation. ## Related Actors - Google Search Scraper - YouTube Scraper - Amazon Product Scraper