AAgent Self-Audit

← Agent Self-Audit

Agent Policy Builder

Decide how AI crawlers and agents may use your website

Choose what to allow for AI training, AI search and AI assistants, and get the robots.txt section to add to your site.

Get started
  • Nothing to install
  • Every device
  • 100 languages

Example output

Made-up example
# Example Ceramics

> Handmade ceramics, shipped from Tallinn.

AI use of this site: model training not permitted; AI search and answers permitted.

## Products

- [Catalogue](https://example.com/shop): every piece in stock

An example for an invented shop. Your files use your own choices.

Your choices

AI model trainingAI model trainingCrawlers that collect pages to train AI models.
AI search and answersAI search and answersCrawlers that index pages for AI search and answer engines.
AI assistants on requestAI assistants on requestAssistants that open a page when a user asks. Some companies may not apply robots.txt to these visits.

Ordinary search crawlers, such as Googlebot and Bingbot, are not affected.

Free section or Pro Kit: what does paying add?

The free tool makes the robots.txt section from your choices. The Pro Kit adds the other files and a guide to install them.

What the Pro Kit gives you

  • robots.txt, llms.txt and ai.txt that all say the same thing.
  • The paths sites of your type usually keep from AI crawlers, added for you.
  • A summary of your AI usage terms in your language and in English.
  • Where to put each file on WordPress, Next.js, Shopify and most other sites.

Free section and Pro Kit side by side

FreePro Kit
robots.txt AI sectionYesYes
Usual paths for your type of siteNoYes
llms.txt and ai.txtNoYes
Terms summary and install guideNoYes

One payment of $6.99. No subscription and nothing renews. If the kit cannot be made or you are charged twice, you get a full refund.

Pro Kit: every file, ready to install

The same choices as one download, plus the files and guides that go with them.

  • robots.txt AI section, with the usual paths for your type of site
  • llms.txt: a short guide to your site for AI systems, with your links
  • ai.txt with your choice on AI training (a convention)
  • AI usage terms summary in your language and in English, to review
  • Install guide for most sites, WordPress, Next.js and Shopify

Links for llms.txt (optional)

Up to 20 important pages. Without links, llms.txt points to your home page.

    $6.99, paid once. Download for 7 days, up to 10 times.

    If the kit cannot be made, you get your money back.

    Your entries stay in this browser to rebuild the kit; we keep only a fingerprint of them with the payment. To download again, use this browser, or enter the same values.

    Secure payments by Stripe. Prices are shown in your local currency.

    Terms of service · Refund policy · Privacy policy

    What's new

    • The top bar now has plain white boxes and no UNIHI Home button (UNIHOLIX Apps is in the footer), and the page is as wide as our other products.
    Agent Policy Builder — robots.txt rules for AI crawlers, llms.txt and ai.txt