spider.science.strath.ac.uk
robots.txt

Robots Exclusion Standard data for spider.science.strath.ac.uk

Resource Scan

Scan Details

Site Domain spider.science.strath.ac.uk
Base Domain strath.ac.uk
Scan Status Ok
Last Scan2025-06-26T13:24:56+00:00
Next Scan 2025-07-26T13:24:56+00:00

Last Scan

Scanned2025-06-26T13:24:56+00:00
URL https://spider.science.strath.ac.uk/robots.txt
Domain IPs 130.159.62.190
Response IP 130.159.62.190
Found Yes
Hash 80844d21ba0a36ced996cc25c2c370d23a1fa753f4df350b10b70fe6af4f9d62
SimHash a84d23814f30

Groups

datacha0s

Rule Path
Disallow /

datacha0s/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /help/

Comments

  • /robots.txt file for http://spider.science.strath.ac.uk
  • User-agent: *
  • Disallow: /