aberystwythguide.org.uk
robots.txt

Robots Exclusion Standard data for aberystwythguide.org.uk

Resource Scan

Scan Details

Site Domain aberystwythguide.org.uk
Base Domain aberystwythguide.org.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-10T14:35:47+00:00
Next Scan 2025-12-10T14:35:47+00:00

Last Successful Scan

Scanned2025-09-18T20:21:23+00:00
URL https://aberystwythguide.org.uk/robots.txt
Domain IPs 185.151.30.167, 2a07:7800::167
Response IP 185.151.30.167
Found Yes
Hash c40023d7755e2ca36149f51783783fd9c2f05f5d7a1fbe826cbf0dbc8d441435
SimHash ab5c9802cbb2

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://www.aberystwythguide.org.uk/sitemap.xml