horniman.ac.uk
robots.txt

Robots Exclusion Standard data for horniman.ac.uk

Resource Scan

Scan Details

Site Domain horniman.ac.uk
Base Domain horniman.ac.uk
Scan Status Ok
Last Scan2024-10-26T09:28:23+00:00
Next Scan 2024-11-25T09:28:23+00:00

Last Scan

Scanned2024-10-26T09:28:23+00:00
URL https://horniman.ac.uk/robots.txt
Redirect https://www.horniman.ac.uk/robots.txt
Redirect Domain www.horniman.ac.uk
Redirect Base horniman.ac.uk
Domain IPs 185.98.214.80
Redirect IPs 185.98.214.80
Response IP 185.98.214.80
Found Yes
Hash 4f3a6f73a38e0d90b944bef7550cd2ffd41c4586cb334c20d0aedfa95ab521c2
SimHash 6518d454e331

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5