Log In Sign Up

aber.ac.uk
robots.txt

Robots Exclusion Standard data for aber.ac.uk

Resource Scan

Scan Details

Site Domain aber.ac.uk
Base Domain aber.ac.uk
Scan Status Ok
Last Scan2024-11-03T06:34:56+00:00
Next Scan 2024-11-17T06:34:56+00:00

Last Scan

Scanned2024-11-03T06:34:56+00:00
URL https://aber.ac.uk/robots.txt
Redirect https://www.aber.ac.uk/robots.txt
Redirect Domain www.aber.ac.uk
Redirect Base aber.ac.uk
Domain IPs 144.124.16.237, 144.124.16.238, 2001:630:2c3:116::1:443, 2001:630:2c3:116::2:443
Redirect IPs 144.124.16.237, 144.124.16.238, 2001:630:2c3:116::1:443, 2001:630:2c3:116::2:443
Response IP 144.124.16.237
Found Yes
Hash 45e4a05c16db73ad997630fef134440f13efaf86b089da11aeec7825663cae0e
SimHash 2503a10d4570

Groups

*

Rule Path
Disallow /en/is/it-services/rooms/workstations/
Disallow /cy/is/it-services/rooms/workstations/
Disallow /en/is/it-services/rooms/availability/
Disallow /cy/is/it-services/rooms/availability/
Disallow /~ccuwww/
Disallow /en/inc/
Disallow /cy/inc/
Disallow /en/0nts-0102/
Disallow /cy/0nts-0102/
Disallow /en/contact-us/directory/
Disallow /cy/contact-us/directory/
Disallow /en/contact-us/directory/staff/profile/
Disallow /cy/contact-us/directory/staff/profile/
Disallow /admin-panel/
Disallow /en/form-manager/
Disallow /cy/form-manager/
Disallow /en/search/
Disallow /cy/search/
Back to top

Comments

  • /robots.txt for http://www.aber.ac.uk/
  • comments to is@aber.ac.uk
  • Last updated 29/1/20 by Suzy (sfs) to remove out of date items
  • Leave this comment in. It just ensures that the file ends correctly.
Back to top

Warnings

  • 1 invalid line.
Back to top