Explicitly list the files within cgi/, since not all crawlers will
honor the following syntax:
Allow: /cgi/foo
Disallow: /cgi/
Description
Description
Details
Details
- Provenance
gjb Authored on - Parents
- rD42830: Remove a stray blank line from robots.txt.
- Branches
- Unknown
- Tags