crudeaccountability.org
robots.txt

Robots Exclusion Standard data for crudeaccountability.org

Resource Scan

Scan Details

Site Domain crudeaccountability.org
Base Domain crudeaccountability.org
Scan Status Ok
Last Scan2025-08-20T18:41:50+00:00
Next Scan 2025-09-19T18:41:50+00:00

Last Scan

Scanned2025-08-20T18:41:50+00:00
URL https://crudeaccountability.org/robots.txt
Domain IPs 199.16.172.136, 199.16.173.171
Response IP 199.16.173.171
Found Yes
Hash 8e9e083c6074b626f8f1896bfed53542fee9fb4800ae2bf475a40b6883c9483d
SimHash 480554904913

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

baidu

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://crudeaccountability.org/sitemap.xml.gz