Log In Sign Up

crusr.com
robots.txt

Robots Exclusion Standard data for crusr.com

Resource Scan

Scan Details

Site Domain crusr.com
Base Domain crusr.com
Scan Status Ok
Last Scan4/12/2025, 5:52:54 AM
Next Scan 5/12/2025, 5:52:54 AM

Last Scan

Scanned4/12/2025, 5:52:54 AM
URL https://crusr.com/robots.txt
Domain IPs 104.21.32.151, 172.67.186.237, 2606:4700:3030::ac43:baed, 2606:4700:3033::6815:2097
Response IP 104.21.32.151
Found Yes
Hash 9153359953952838ee72ea5ebcd1e1e3b3577533c8ab6a577c56e0b74fb4643e
SimHash 891554148913

Groups

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow /ccrusr.php
Back to top

Other Records

Field Value
sitemap https://crusr.com/sitemap.xml
Back to top