-
I added a llms.txt recently and started monitoring the activity on that page. My website gets crawled a lot by a lot of different bots. Every page receives bot traffic including robots.txt and sitemap. But no bot has crawled my llms.txt so far. And yes it’s mentioned in the robots.txt.
I think some people are trying hard to make it a standard, but until now it is doing little to nothing i think.
