nevergetfooled.com
robots.txt

Robots Exclusion Standard data for nevergetfooled.com

Resource Scan

Scan Details

Site Domain nevergetfooled.com
Base Domain nevergetfooled.com
Scan Status Ok
Last Scan2025-07-02T09:28:20+00:00
Next Scan 2025-07-09T09:28:20+00:00

Last Scan

Scanned2025-07-02T09:28:20+00:00
URL https://nevergetfooled.com/robots.txt
Domain IPs 104.21.47.217, 172.67.172.208, 2606:4700:3033::6815:2fd9, 2606:4700:3033::ac43:acd0
Response IP 172.67.172.208
Found Yes
Hash f20812c2a21c95d439f53cf58e60cc134eda5dbbdc9bd3876c7aa4d3a6c7f6e0
SimHash 4d54d9752753

Groups

bingbot

Rule Path
Allow /

yisouspider

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

baiduspider

Rule Path
Allow /

googlebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.