# LimeHub LLMs.txt
# This file defines LimeHub’s policy on AI and large language model crawlers.
# Last updated: November 2025

# --- Major AI crawlers and data-collection agents ---

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: OpenAI
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: Bard
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: YouBot
Disallow: /

User-agent: *
Disallow: /

# --- Notes ---
# 1. This policy allows normal web crawlers (Googlebot, Bingbot, etc.) to index the site.
# 2. It explicitly denies use of LimeHub’s content for AI model training or dataset creation.
# 3. For SEO purposes, robots.txt continues to manage traditional crawler access.