wifinetnews.com
robots.txt

Robots Exclusion Standard data for wifinetnews.com

Resource Scan

Scan Details

Site Domain wifinetnews.com
Base Domain wifinetnews.com
Scan Status Ok
Last Scan2025-05-14T07:39:04+00:00
Next Scan 2025-05-21T07:39:04+00:00

Last Scan

Scanned2025-05-14T07:39:04+00:00
URL https://wifinetnews.com/robots.txt
Domain IPs 45.79.66.15
Response IP 45.79.66.15
Found Yes
Hash f7a0d12bd6bc64546ba57b641688f90da56855b02ed35d10e3709ebd3bb0c20b
SimHash fd5e5960dd58

Groups

google-extended

Rule Path
Disallow /

test

Rule Path
Disallow /

beta

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /dont.index/
Disallow /temp/
Disallow /data/
Disallow /scripts/
Disallow /bin/

claudebot

Rule Path
Disallow /

Comments

  • everybody else is ok, but restrict directories