Log In Sign Up

abdn.ac.uk
robots.txt

Robots Exclusion Standard data for abdn.ac.uk

Resource Scan

Scan Details

Site Domain abdn.ac.uk
Base Domain abdn.ac.uk
Scan Status Ok
Last Scan2024-05-29T16:14:16+00:00
Next Scan 2024-06-28T16:14:16+00:00

Last Scan

Scanned2024-05-29T16:14:16+00:00
URL https://abdn.ac.uk/robots.txt
Redirect https://www.abdn.ac.uk/robots.txt
Redirect Domain www.abdn.ac.uk
Redirect Base abdn.ac.uk
Domain IPs 139.133.1.4
Redirect IPs 139.133.1.4
Response IP 139.133.1.4
Found Yes
Hash 51c60a06abdaeeadb47417946f4ff13a6ac9d0222e15a7917b615c954a250e9a
SimHash 471a84d065d6

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Comments

  • ==============================
  • UoA robots.txt
  • Please respect options below.
  • ==============================
Back to top