cleartest.org
robots.txt

Robots Exclusion Standard data for cleartest.org

Resource Scan

Scan Details

Site Domain cleartest.org
Base Domain cleartest.org
Scan Status Ok
Last Scan2025-07-26T22:53:21+00:00
Next Scan 2025-08-25T22:53:21+00:00

Last Scan

Scanned2025-07-26T22:53:21+00:00
URL https://cleartest.org/robots.txt
Domain IPs 104.21.80.211, 172.67.153.212, 2606:4700:3036::6815:50d3, 2606:4700:3037::ac43:99d4
Response IP 104.21.80.211
Found Yes
Hash a45a0ebcbc7cc6c5b8fa7c2c02d14a6665c121c91fcc0249c092686f6cdf8579
SimHash 6da060626b10

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /tools/
Disallow /cgi-bin/
Disallow /blog/wp-admin/
Disallow /whmcspriv/
Disallow /phpmyadmin/
Disallow /crons/
Disallow /cart.php
Disallow /clientarea.php
Disallow /pwreset.php
Disallow /register.php
Disallow /search
Disallow /*/feed/
Disallow /*/?p=
Disallow /*?utm_source=
Disallow /disclosure-policy/
Disallow /*/page/
Disallow /?s=
Disallow /author/

Other Records

Field Value
sitemap https://cleartest.org/sitemap_index.xml