wehub-resource-sync
9 lines
301 B
Plaintext
9 lines
301 B
Plaintext
# Algolia-Crawler-Verif: C37A60AFB138256B
|
|
User-agent: *
|
|
Disallow: /
|
|
Allow: /*/latest/
|
|
Allow: /en/latest/ # Fallback for bots that don't understand wildcards
|
|
Allow: /*/master/
|
|
Allow: /en/master/ # Fallback for bots that don't understand wildcards
|
|
Sitemap: https://docs.ray.io/en/latest/sitemap.xml
|