whythese.com
robots.txt

Robots Exclusion Standard data for whythese.com

Resource Scan

Scan Details

Site Domain whythese.com
Base Domain whythese.com
Scan Status Ok
Last Scan2024-06-12T17:12:58+00:00
Next Scan 2024-06-19T17:12:58+00:00

Last Scan

Scanned2024-06-12T17:12:58+00:00
URL https://whythese.com/robots.txt
Domain IPs 104.26.10.250, 104.26.11.250, 172.67.68.105, 2606:4700:20::681a:afa, 2606:4700:20::681a:bfa, 2606:4700:20::ac43:4469
Response IP 172.67.68.105
Found Yes
Hash ec4d8d8673ec4e00a33c3f84fba8811824ed0f05a335b13c1965c172a5ac47c2
SimHash 01409b60c711

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /