A LLM friendly website crawler purposefully build to creating RAG and Agents Knowledge base. Just provide the root url and the website will be crawled. You will get clean output which is LLM friendly for post processing.

What does this actor do?

Orbiter is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

• Cloud-based execution - no local setup required
• Scalable infrastructure for large-scale operations
• API access for integration with your applications
• Built-in proxy rotation and anti-blocking measures
• Scheduled runs and webhooks for automation

How to Use

1. Click "Try This Actor" to open it on Apify
2. Create a free Apify account if you don't have one
3. Configure the input parameters as needed
4. Run the actor and download your results