The /llms.txt file, helping language models use your website github.com 4 points by mooreds a day ago
TimorousBestie 19 hours ago LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.
LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.