Log In Sign Up

basictheorytest.org
robots.txt

Robots Exclusion Standard data for basictheorytest.org

Resource Scan

Scan Details

Site Domain basictheorytest.org
Base Domain basictheorytest.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-07T02:28:39+00:00
Next Scan 2025-08-06T02:28:39+00:00

Last Successful Scan

Scanned2025-06-08T02:05:41+00:00
URL https://basictheorytest.org/robots.txt
Redirect https://www.basictheorytest.org/robots.txt
Redirect Domain www.basictheorytest.org
Redirect Base basictheorytest.org
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash 86e78353968c43a7a54846123f1272af8932af2cdd980cb4303602bd57208880
SimHash 6d116444c391

Groups

*

Rule Path
Disallow /admin/
Disallow /shared/
Disallow /cgi-bin/
Back to top