stir.ac.uk
robots.txt

Robots Exclusion Standard data for stir.ac.uk

Resource Scan

Scan Details

Site Domain stir.ac.uk
Base Domain stir.ac.uk
Scan Status Ok
Last Scan2024-10-14T16:26:36+00:00
Next Scan 2024-11-13T16:26:36+00:00

Last Scan

Scanned2024-10-14T16:26:36+00:00
URL https://stir.ac.uk/robots.txt
Redirect https://www.stir.ac.uk/robots.txt
Redirect Domain www.stir.ac.uk
Redirect Base stir.ac.uk
Domain IPs 20.90.134.11
Redirect IPs 13.43.142.121, 3.11.72.25
Response IP 13.43.142.121
Found Yes
Hash 023ffbebd1a275b9c232f146b55963f156a51cbc2889136d2ce67a0edf786b95
SimHash ed4de7620e93

Groups

funnelback

Rule Path
Allow /internal-staff/
Allow /internal-students/

*

Rule Path
Disallow /404/
Disallow /archive/
Disallow /comms/
Disallow /courses/module/
Disallow /data/video/
Disallow /expert/in/
Disallow /personalisation/
Disallow /reports/
Disallow /research/hub/tag/
Disallow /tests/
Disallow /testing-training/
Disallow /training/

Other Records

Field Value
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/?sn=sitemap_images.xml
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/?sn=sitemap_video.xml
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/index.php
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/index.php?sn=sitemap_images.xml
sitemap https://www.stir.ac.uk/media/dist/php/sitemap/index.php?sn=sitemap_video.xml