whytherush.com
robots.txt

Robots Exclusion Standard data for whytherush.com

Resource Scan

Scan Details

Site Domain whytherush.com
Base Domain whytherush.com
Scan Status Ok
Last Scan2025-08-17T00:57:40+00:00
Next Scan 2025-09-16T00:57:40+00:00

Last Scan

Scanned2025-08-17T00:57:40+00:00
URL https://www.whytherush.com/robots.txt
Domain IPs 104.21.83.190, 172.67.180.220, 2606:4700:3033::6815:53be, 2606:4700:3037::ac43:b4dc
Response IP 172.67.180.220
Found Yes
Hash 1d5f26af1550bdc44e23b6b6160277005ffaa43f7b80e635516050fbf27d2fa9
SimHash 113cd620d0c2

Groups

nerdybot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bubing

Rule Path
Disallow /