HTTP API & Webhook Gateway

HTTP API & Webhook Gateway

by amernas

A dual-purpose Apify actor that makes HTTP calls to any external API and provides a secure endpoint to receive and process incoming webhooks, connecting your automations to the wider web.

1,244 runs
22 users
Try This Actor

Opens on Apify.com

About HTTP API & Webhook Gateway

Ever needed to make an API call from an Apify actor, but hit a wall because your workflow can only trigger other actors? Or maybe you've struggled to get a reliable, secure endpoint for incoming webhooks from third-party services? That's exactly why I built this actor. Think of it as your universal adapter. It acts as a full-featured HTTP client, so you can send GET, POST, or any other type of request to external APIs directly from your Apify task. On the flip side, it gives you a permanent, stable URL to receive webhooks. When a webhook hits, it automatically triggers your configured actor, passing along all the payload data. I use it all the time to connect Apify scrapers to CRMs, send data to Slack, or process form submissions from tools like Zapier. It handles authentication headers, custom payloads, and retries, so you don't have to build that plumbing yourself. It essentially bridges the gap between Apify's actor-based automation and the wider world of web APIs and event-driven services.

What does this actor do?

HTTP API & Webhook Gateway is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

HTTP API & Webhook Gateway

An Apify Actor for making HTTP requests to external APIs. It handles the complexities of network communication, including retries, proxy rotation, and error handling, so you can focus on integrating services.

Overview

This actor is a configurable HTTP client. You define the request (URL, method, headers, data), and it executes it, returning the response. It's useful for API integration, webhook forwarding, automated testing, and data collection tasks where direct HTTP calls from your code are impractical or need enhanced reliability.

Key Features

  • Full HTTP Support: All standard methods (GET, POST, PUT, DELETE, PATCH, etc.).
  • Flexible Data Handling: Send JSON, form-encoded data, or raw content.
  • Robust Execution:
    • Automatic retries with exponential backoff for transient failures.
    • Integrated Apify Proxy support for IP rotation.
    • Configurable timeouts and redirect handling.
  • Security: Sensitive data like credentials are not logged.
  • Multiple Response Formats: Handles JSON, text, and binary responses.

How to Use

Configure the actor using a JSON input object. Only the url field is strictly required.

Basic Structure

{
  "method": "GET",
  "url": "https://api.example.com/endpoint",
  "headers": {
    "Authorization": "Bearer YOUR_TOKEN"
  },
  "data": { /* Request body for POST/PUT */ },
  "params": { /* URL query parameters */ },
  "retry": { "attempts": 3 },
  "proxySettings": { "useApifyProxy": true }
}

Common Examples

Simple GET Request:

{
  "method": "GET",
  "url": "https://jsonplaceholder.typicode.com/posts/1"
}

POST with JSON Data:

{
  "method": "POST",
  "url": "https://api.example.com/users",
  "headers": { "Content-Type": "application/json" },
  "data": { "name": "John", "email": "john@example.com" }
}

Request with Query Parameters & Retries:

{
  "url": "https://api.example.com/search",
  "params": { "q": "term", "page": 1 },
  "retry": { "attempts": 3, "backoffSeconds": 2 }
}

Input Configuration

Field Required Description Default
url Yes The target endpoint URL. -
method No HTTP method. "GET"
headers No Object containing HTTP headers. {}
data No Request body data (for POST, PUT, PATCH). -
params No Object for URL query parameters. {}
timeoutSecs No Request timeout in seconds. 60
followRedirects No Follow HTTP redirects. true
bodyMode No How to encode data: "auto", "json", "form", "raw". "auto"
retry No Retry configuration object. -
attempts No Number of retry attempts. 1
backoffSeconds No Base delay between retries. 1
proxySettings No Proxy configuration. -
useApifyProxy No Enable Apify Proxy. false
apifyProxyGroups No Array of proxy groups, e.g., ["RESIDENTIAL"]. -
verbose No Enable detailed debug logging. false

Output

The actor returns a JSON object containing the HTTP response and execution details.

{
  "url": "https://api.example.com/data",
  "method": "GET",
  "statusCode": 200,
  "headers": { /* Response headers */ },
  "body": { /* Parsed response body (e.g., JSON) */ },
  "rawBody": "...", // Raw response text
  "retryCount": 0,
  "error": null // Contains error details if the request failed
}

On failure, the error field will contain a message and the statusCode will reflect the HTTP error (e.g., 429, 500). The actor will only throw after exhausting all retry attempts.

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try HTTP API & Webhook Gateway now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
amernas
Pricing
Paid
Total Runs
1,244
Active Users
22
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support