peterguyton.com
robots.txt

Robots Exclusion Standard data for peterguyton.com

Resource Scan

Scan Details

Site Domain peterguyton.com
Base Domain peterguyton.com
Scan Status Ok
Last Scan2024-09-21T08:12:23+00:00
Next Scan 2024-10-21T08:12:23+00:00

Last Scan

Scanned2024-09-21T08:12:23+00:00
URL https://peterguyton.com/robots.txt
Redirect http://www.peterguyton.com/robots.txt
Redirect Domain www.peterguyton.com
Redirect Base peterguyton.com
Domain IPs 104.21.45.157, 172.67.216.104, 2606:4700:3035::ac43:d868, 2606:4700:3037::6815:2d9d
Redirect IPs 104.18.132.62, 104.18.133.62, 104.18.134.62, 104.18.135.62, 104.18.136.62
Response IP 104.18.135.62
Found Yes
Hash 1d5f26af1550bdc44e23b6b6160277005ffaa43f7b80e635516050fbf27d2fa9
SimHash 113cd620d0c2

Groups

nerdybot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bubing

Rule Path
Disallow /