jamesjshaw.co.uk
robots.txt

Robots Exclusion Standard data for jamesjshaw.co.uk

Resource Scan

Scan Details

Site Domain jamesjshaw.co.uk
Base Domain jamesjshaw.co.uk
Scan Status Ok
Last Scan2025-06-08T07:53:04+00:00
Next Scan 2025-07-08T07:53:04+00:00

Last Scan

Scanned2025-06-08T07:53:04+00:00
URL https://www.jamesjshaw.co.uk/robots.txt
Domain IPs 104.18.132.62, 104.18.133.62, 104.18.134.62, 104.18.135.62, 104.18.136.62
Response IP 104.18.134.62
Found Yes
Hash 1d5f26af1550bdc44e23b6b6160277005ffaa43f7b80e635516050fbf27d2fa9
SimHash 113cd620d0c2

Groups

nerdybot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bubing

Rule Path
Disallow /