llms.txt

llms.txt is an emerging standard for communicating website structure and purpose to LLM crawlers. Similar to how robots.txt tells search engines what to crawl, llms.txt provides AI models with a structured summary of a site's content, products, and key pages. Implementing llms.txt helps AI models better understand and represent a website's content in their responses.