The LLMS.TXT Generator | Hi LLMS

The LLMS.TXT Generator | Hi LLMS

by onescales

The most powerful tool online to generate LLMS - llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, and reco...

308 runs
31 users
Try This Actor

Opens on Apify.com

About The LLMS.TXT Generator | Hi LLMS

The most powerful tool online to generate LLMS - llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, and recommended by ChatGPT, Claude, Google Gemini, Perplexity, Grok, and every AI. (Great for AEO, AIO, GEO, SEO) Transform your site to AI-friendly today!

What does this actor do?

The LLMS.TXT Generator | Hi LLMS is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

The LLMS.TXT Generator | Hi LLMS The easiest and most powerful tool online to generate llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, understood, and recommended by ChatGPT, Claude, Google Gemini, Perplexity, Grok, and every AI. Transform your site into an AI-friendly powerhouse today! Watch the video ## What is llms.txt? llms.txt is a standard file format that helps AI models understand and navigate your website's content. It provides a structured overview of your site's key pages with descriptions, making it easier for LLMs to reference your content accurately. Most other llms.txt generator miss the part about markdown. They summarize your pages in a short sentence in llms.txt but they DON'T provide AI's the full content of each and every page. We got your covered. We do it all! How it Works: 1. Fill out the domain of your website (i.e. onescales.com). We will find your sitemap and a list of all your pages on your site. 2. Specify the url of where you will upload your markdown and llms.txt file. 3. Click on start 4. Once run is finished, check out the output tab, Scroll to the bottom and click on the link on row llms.zip 5. Unzip the zip file and upload it to your directory of where you sepcified your markdown files. 6. Enjoy better visibility from Ai's ## Features - Flexible URL Input: Accept domains, sitemaps, or specific page lists - Automatic Sitemap Detection: Finds sitemap.xml or sitemap_index.xml automatically - Smart Categorization: Automatically organizes URLs based on your site type (SaaS, E-commerce, Service, Media/Blog, Other) - Content Extraction: Uses Mozilla Readability to extract clean content from each page - Markdown Conversion: Converts page content to markdown format - Resume/Retry Capability: Continue from failed runs and merge results - Multiple Outputs: Generates llms.txt, llms-full.txt, individual markdown files, and a complete zip package - Marketing Efforts: Helps with your SEO, GEO, AIO, AEO optimization efforts ## How It Works ### URL Input Options The actor accepts three types of input in the URL(s) field: #### 1. Domain Name (Sitemap Auto-Discovery) apple.com example.org #### 2. Full Sitemap URL https://apple.com/sitemap.xml https://example.com/sitemap_index.xml #### 3. Specific Page URLs (List) https://apple.com/about https://apple.com/pricing https://apple.com/contact ## Resume/Retry Feature If for any reason any of the pages fail to process, just use the retry tab and specify the Run ID of your past failed run with the error urls and it will re-rerun. ## Input Requirements ### Required Fields: - URL(s): Domain, Sitemap URL or List of Pages: See URL Input Options above - Website/Business Name: Your site name (max 500 characters) - Website/Business Description: Brief description of your site (max 800 characters) - Website/Business Category: Choose from SaaS, E-commerce, Service, Media/Blog, or Other ### Optional Fields: Resume/Retry Section: - Add to Previous llms.txt (if prior run failed): Enter Run ID to resume/merge Advanced Settings: - Maximum Number of Pages: Limit the number of pages to process - Pause between pages: Add delay between requests (1-100 seconds) - URL Format in llms.txt: Original URLs or Markdown URLs - URL Path for Markdown Files: Custom path for .md files - Proxy Configuration: Configure proxy settings (defaults to Apify proxy) ## Output ### Dataset Table Columns: | Column | Description | |--------|-------------| | URL | Page URL or file name | | Status | Complete or Error | | Run ID | The run ID that created this file (use for retry) | | Failed URLs | List of failed URLs (shown in llms.txt row only) | | Comments | Error details if status is Error | | Content | Preview of the content | | File Size (bytes) | Size of the file | | URL to Download | Direct download link | ### Generated Files: 1. llms.txt: Main index file with categorized URLs 2. llms-full.txt: Complete content archive 3. Individual .md files: Clean markdown for each page 4. llms.zip: Everything packaged together 5. instructions.txt: Installation guide (in zip) ## Use Cases - Make your website AI-friendly (SEO, GEO, AIO, AEO) - Improve how LLMs reference your content - Create structured documentation for AI models - Generate clean markdown archives of your site - Maintain up-to-date llms.txt files with retry capability ## FAQs Q. Can i Set an Automatic Schedule (for example, once a week) A. Yes, just click on top right hand side on 3 dots and "schedule actor" and select your timing. Q. How to Integrate with my Website (shopify, wordpress, drupal, magento, bigcommerce, wix, weebly, squarespace, etc) A. We are in process of creating tutorials and apps. Will update you once ready. Q. How to Integrate with automation (zapier, n8n, make.com, ifttt) A. We are in process of creating tutorials and apps. Will update you once ready. Q. How to report a bug, suggest or feature request? A. Fill out the form below. We are here to help: https://docs.google.com/forms/d/e/1FAIpQLSfsKyzZ3nRED7mML47I4LAfNh_mBwkuFMp1FgYYJ4AkDRgaRw/viewform?usp=dialog ## Roadmap We plan to improve our app with the following in the future: - Excluding URLs - Additional Website Categories - How to Integrate with Automations (Zapier, n8n, make.com, shopify, wordpress) - Better Error Handling - Token Size for Files - Hash for Files - Reference for Meta Tags (rel alternate type text/markdown) - Possible AI support for better content generation - Improved speed of crawling - Markdown file folder structure support - Support for js heavy sites (with playwright) ## Release Notes - V1: First version: November 18th, 2025 - V2: Faster Processing, 2nd Processing for Smaller Pages : November 19th, 2025 ## Support Questions or need additional features? Fill out the form at: https://docs.google.com/forms/d/e/1FAIpQLSfsKyzZ3nRED7mML47I4LAfNh_mBwkuFMp1FgYYJ4AkDRgaRw/viewform?usp=dialog

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try The LLMS.TXT Generator | Hi LLMS now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
onescales
Pricing
Paid
Total Runs
308
Active Users
31
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support