Ahrefs built a free llms.txt generator from 137,000 domains
Ahrefs just released a free llms.txt generator, and the tool is grounded in actual data: an analysis of 137,000 domains.
What Is llms.txt?
The llms.txt file is a proposed standard that helps AI systems understand how to crawl and use content from your site. Think of it as a robots.txt for large language models. If you care about showing up in AI-powered search results or chat interfaces, having one on your domain is increasingly discussed as a best practice in generative engine optimization (GEO) circles.
What Ahrefs Built
The generator is free to use. According to Ahrefs, the tool was built on top of detailed analysis of 137,000 domains, which gives it a wider empirical base than most of the ad hoc generators that have appeared over the past year.
Ryan Law authored the release. Ahrefs is positioning it as a resource worth sharing with bosses, clients, and GEO agencies, which suggests they see adoption still being in early stages.
The Operator Angle
If you run a content site, an affiliate site, or any web property that depends on search traffic, the conversation about AI crawlability is not going away. Tools like this let you get a file in place quickly without writing one from scratch.
Whether llms.txt actually influences how AI systems treat your content is still an open question. Ahrefs does not claim it guarantees visibility in AI search. But given the tool is free and setup is low effort, the cost of testing it is close to zero.
The Takeaway
Free, data-backed, and directly relevant to anyone tracking how AI is reshaping organic reach. Worth five minutes to run your domain through it and see what the generator produces.
Try the free llms.txt generator from Ahrefs.
I’m founder of BizStack at Cagri Sarigoz LLC and a passionate advocate for entrepreneurs.
With over 14 years in tech, marketing, and AI, including my role as Head of SEO at CitizenShipper and co-founder of TaleBot at Intale AI, I’m dedicated to sharing genuine, useful product insights and tips.
At BizStack, I aim to cut through the digital noise to provide clear, actionable advice.
And more than all else, I’m a father to a (always) little girl and a husband.
Contact me at [email protected] for assistance.
