wehub-resource-sync
15 lines
375 B
Plaintext
15 lines
375 B
Plaintext
# ───── Live user-initiated fetches (allow) ─────
|
|
User-agent: Claude-User
|
|
User-agent: ChatGPT-User
|
|
User-agent: Perplexity-User
|
|
User-agent: Meta-ExternalFetcher
|
|
User-agent: DuckAssistBot
|
|
User-agent: MistralAI-User
|
|
User-agent: kagi-fetcher
|
|
User-agent: Manus-User
|
|
Allow: /
|
|
|
|
# ───── Everything else (block) ─────
|
|
User-agent: *
|
|
Disallow: /
|