purbeton.com
robots.txt

Robots Exclusion Standard data for purbeton.com

Resource Scan

Scan Details

Site Domain purbeton.com
Base Domain purbeton.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-21T00:22:51+00:00
Next Scan 2026-02-04T00:22:51+00:00

Last Successful Scan

Scanned2026-01-05T23:59:50+00:00
URL https://purbeton.com/robots.txt
Redirect https://www.purbeton.com/robots.txt
Redirect Domain www.purbeton.com
Redirect Base purbeton.com
Domain IPs 179.61.189.140, 2a02:4780:84:5bdc:4f91:23f3:858c:a747, 2a02:4780:84:94c3:260b:5c8:4763:6d20, 77.37.66.105
Redirect IPs 2a02:4780:84:7eac:578f:c057:754f:e787, 2a02:4780:84:c46e:3085:dba9:26fa:e85e, 84.32.84.137, 84.32.84.14
Response IP 93.127.196.136
Found Yes
Hash 1eb116d4b2c2707acb60a73eda6c17bc251129b2039da3f2c71232503a653e8b
SimHash 61015c40c993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.purbeton.com/sitemap_index.xml