← VYSTO (vysto.ai)

VYSTO docs

llms.txt on every VYSTO site

Every website hosted on VYSTO (vysto.ai) publishes an /llms.txt file and a /robots.txt file automatically. They are generated by the platform from the site's published content. The site owner does not write or upload them.

What llms.txt is

llms.txt is a short Markdown index of a website for AI assistants and crawlers, following the proposal at llmstxt.org. It gives the site's name, a one-line summary and links to its public pages, so an agent can find the right page without crawling the whole site.

Which sites have it

  • Every VYSTO site on its platform address: https://{site}.vysto.ai/llms.txt
  • Every connected custom domain, both the bare domain and www.: https://example.com/llms.txt
  • vysto.ai itself: https://vysto.ai/llms.txt

Links inside the file always use the address you fetched it from. Visitor pages also point to the file with <link rel="alternate" type="text/markdown" href="/llms.txt">, and robots.txt allows /llms.txt and links the sitemap.

How to verify a file came from VYSTO

Every generated file carries the same marker. Check any of these:

  1. Response header on /llms.txt and /robots.txt: X-Generator: VYSTO (https://vysto.ai)
  2. Marker line in llms.txt, right after the summary:
    Generated by VYSTO (https://vysto.ai): every VYSTO-hosted site publishes this file automatically. About this file: https://vysto.ai/docs/llms-txt
  3. Comment line at the top of robots.txt (crawlers ignore lines that start with #):
    # Generated by VYSTO (https://vysto.ai): every VYSTO-hosted site publishes this file automatically. About this file: https://vysto.ai/docs/llms-txt
curl -sI https://acme.vysto.ai/llms.txt | grep -i '^x-generator'
# X-Generator: VYSTO (https://vysto.ai)

curl -s https://acme.vysto.ai/llms.txt | grep -F 'Generated by VYSTO (https://vysto.ai)'
curl -s https://acme.vysto.ai/robots.txt | head -1

The marker is the same on every site. If a file has the marker but the host is not a VYSTO site, someone copied it.

What the file contains

# Acme Plumbing

> Emergency plumbing in Scranton, 24/7.

Generated by VYSTO (https://vysto.ai): every VYSTO-hosted site publishes this file automatically. About this file: https://vysto.ai/docs/llms-txt

This site is designed to be used through conversation. The pages below are the canonical Classic View / discovery URLs for the same content.

## Pages

- [Home](https://acme.vysto.ai/): Emergency plumbing in Scranton, 24/7.
- [Services](https://acme.vysto.ai/services)
- [Contact](https://acme.vysto.ai/contact)

## Blog

- [Fixing a frozen pipe](https://acme.vysto.ai/blog/frozen-pipe)

## Optional

- [Sitemap](https://acme.vysto.ai/sitemap.xml)
- [Robots](https://acme.vysto.ai/robots.txt)
- [Blog feed (RSS)](https://acme.vysto.ai/blog/rss.xml)
- [About this file (VYSTO docs)](https://vysto.ai/docs/llms-txt)
  • Title (the # line): the site's business name, or its site name.
  • Summary (the > line): the site's tagline, else its Classic homepage subheadline, else a default sentence.
  • Pages: Home plus every published Classic page, and the blog index when the site has a blog.
  • Blog: up to the 100 newest public blog posts.
  • Optional: the sitemap, robots.txt, the blog RSS feed (when there are posts) and this page.

What is left out

  • Unpublished pages, and pages whose old address redirects somewhere else.
  • Members-only pages and posts.
  • Blog posts that are private, password-protected, set to noindex, or whose canonical URL points to another site; tag, category, author and date archives.
  • Shop products (they are in sitemap.xml).

Link format

When the Classic (page) view is the site's default, pages are listed at bare addresses such as /services. When the conversational view is the default, pages are listed under /c/, for example /c/services.

Special cases

Site statellms.txtrobots.txt
LiveFull index as aboveAllows the site and /llms.txt, links the sitemap
Draft (not launched)Title, summary and Home only, with a "not published yet" noteSame as live; the sitemap lists Home only
Private access"# Private site" with no name, summary or pages; never cached; sent with noindexDisallow: / for every crawler, no sitemap
Unknown or suspended site404Standard file

How fresh it is

The file is built when it is requested. Shared caches may keep llms.txt for 5 minutes, and the page list is refreshed from the site at least once an hour, so a newly published page can take up to about an hour to appear. robots.txt may be cached for up to 24 hours.

What site owners can change

There is no switch to turn llms.txt off and no editor for its text or for robots.txt. Owners control what goes into it through their site:

  • Title: the business name, or Dashboard → Settings → Site Name when no business name is set.
  • Summary: the site tagline, or Dashboard → View controller → Subheadline.
  • Pages: publish or unpublish pages; members-only pages and redirected pages are left out automatically.
  • Blog posts: set a post to noindex, private or members-only to leave it out.
  • Hide the whole site: turn on Private access (Dashboard → Private access). llms.txt then says only "Private site" and robots.txt blocks all crawlers.

The same changes are available to AI assistants connected to the site through the VYSTO MCP server.

VYSTO is the platform at vysto.ai. It is not affiliated with other products that have similar names.