daoc.allakhazam.com
robots.txt

Robots Exclusion Standard data for daoc.allakhazam.com

Resource Scan

Scan Details

Site Domain daoc.allakhazam.com
Base Domain allakhazam.com
Scan Status Ok
Last Scan2024-04-25T14:28:38+00:00
Next Scan 2024-05-25T14:28:38+00:00

Last Scan

Scanned2024-04-25T14:28:38+00:00
URL https://daoc.allakhazam.com/robots.txt
Redirect https://camelot.allakhazam.com/robots.txt
Redirect Domain camelot.allakhazam.com
Redirect Base allakhazam.com
Domain IPs 13.33.88.121, 13.33.88.37, 13.33.88.69, 13.33.88.86
Redirect IPs 13.33.88.121, 13.33.88.37, 13.33.88.69, 13.33.88.86
Response IP 13.33.88.121
Found Yes
Hash 12dbcce7e0fbbe22303fc71c9bdd2f3438691088bc442a6d82485a6663085975
SimHash e100386209a3

Groups

*

Rule Path
Disallow /cgi-bin/ratings.pl
Disallow /cgi-bin/prefs-new.pl
Disallow /fsearch.html
Disallow /wiki.html?h=
Disallow /images/
Disallow /fcluster/gotopost.pl

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20