cleartest.org
robots.txt
Robots Exclusion Standard data for cleartest.org
Resource Scan
Scan Details
Site Domain | cleartest.org |
Base Domain | cleartest.org |
Scan Status | Ok |
Last Scan | 2025-07-26T22:53:21+00:00 |
Next Scan | 2025-08-25T22:53:21+00:00 |
Last Scan
Scanned | 2025-07-26T22:53:21+00:00 |
URL | https://cleartest.org/robots.txt |
Domain IPs | 104.21.80.211, 172.67.153.212, 2606:4700:3036::6815:50d3, 2606:4700:3037::ac43:99d4 |
Response IP | 104.21.80.211 |
Found | Yes |
Hash | a45a0ebcbc7cc6c5b8fa7c2c02d14a6665c121c91fcc0249c092686f6cdf8579 |
SimHash | 6da060626b10 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /tools/ |
Disallow | /cgi-bin/ |
Disallow | /blog/wp-admin/ |
Disallow | /whmcspriv/ |
Disallow | /phpmyadmin/ |
Disallow | /crons/ |
Disallow | /cart.php |
Disallow | /clientarea.php |
Disallow | /pwreset.php |
Disallow | /register.php |
Disallow | /search |
Disallow | /*/feed/ |
Disallow | /*/?p= |
Disallow | /*?utm_source= |
Disallow | /disclosure-policy/ |
Disallow | /*/page/ |
Disallow | /?s= |
Disallow | /author/ |
Other Records
Field | Value |
---|---|
sitemap | https://cleartest.org/sitemap_index.xml |