community.fightcrc.org
robots.txt

Robots Exclusion Standard data for community.fightcrc.org

Resource Scan

Scan Details

Site Domain community.fightcrc.org
Base Domain fightcrc.org
Scan Status Ok
Last Scan2025-09-20T04:15:59+00:00
Next Scan 2025-10-04T04:15:59+00:00

Last Scan

Scanned2025-09-20T04:15:59+00:00
URL https://community.fightcrc.org/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.128.53
Found Yes
Hash 1ddd838904cd2ad0ef04d2e009ec4f13ffb7d594afd0a6c83803f07b4be3546d
SimHash c24091708370

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/10123374*
Disallow /spaces/12811825*
Disallow /spaces/18953081*
Disallow /spaces/18503479*
Disallow /spaces/20493722*
Disallow /spaces/21136790*
Disallow /spaces/12793584*
Disallow /spaces/12793620*
Disallow /spaces/12793670*
Disallow /spaces/20104729*
Disallow /spaces/10123409*
Disallow /spaces/12793607*
Disallow /spaces/15891777*
Disallow /spaces/19888439*
Disallow /spaces/21123486*
Disallow /spaces/19888444*
Disallow /spaces/10554129*
Disallow /spaces/12755388*
Disallow /spaces/10123389*
Disallow /spaces/10888901*
Disallow /spaces/15891807*
Disallow /spaces/17215426*
Disallow /spaces/14326991*
Disallow /spaces/21136742*
Disallow /spaces/21136745*
Disallow /spaces/21136730*
Disallow /spaces/21136729*
Disallow /spaces/21136691*
Disallow /spaces/21136792*
Disallow /spaces/21136796*
Disallow /spaces/12793673*
Disallow /spaces/12793665*
Disallow /spaces/12793613*
Disallow /spaces/19724830*
Disallow /spaces/10123397*
Disallow /spaces/21301399*
Disallow /spaces/10942102*
Disallow /spaces/15891879*
Disallow /spaces/21284627*
Disallow /spaces/14480580*
Disallow /spaces/10123283*
Disallow /spaces/15891863*
Disallow /spaces/12793612*
Disallow /spaces/12793669*
Disallow /spaces/20048033*
Disallow /spaces/15891870*
Disallow /spaces/19286725*
Disallow /spaces/12793622*
Disallow /spaces/15891695*
Disallow /spaces/15891871*
Disallow /spaces/15891691*
Disallow /spaces/10123378*
Disallow /spaces/15891808*
Disallow /spaces/15827934*
Disallow /spaces/18952896*
Disallow /spaces/15891817*
Disallow /spaces/7369945*
Disallow /spaces/15891722*
Disallow /spaces/11518213*
Disallow /spaces/19983923*
Disallow /spaces/7437252*
Disallow /spaces/21208205*
Disallow /spaces/15891818*
Disallow /spaces/20493777*
Disallow /spaces/15891713*
Disallow /spaces/21136744*
Disallow /spaces/20493770*
Disallow /spaces/15891872*
Disallow /spaces/10123385*
Disallow /spaces/17844157*
Disallow /spaces/10123395*
Disallow /spaces/12793585*
Disallow /spaces/12793614*
Disallow /spaces/19888018*
Disallow /spaces/10123401*
Disallow /spaces/15891778*
Disallow /spaces/13596734*
Disallow /spaces/21036497*
Disallow /spaces/10123380*
Disallow /spaces/8482448*
Disallow /spaces/10123404*
Disallow /spaces/15891810*
Disallow /spaces/12793583*
Disallow /spaces/15891768*
Disallow /spaces/7427480*
Disallow /spaces/6746532*
Disallow /spaces/20103607*
Disallow /spaces/19284663*
Disallow /spaces/17309159*
Disallow /spaces/15891875*
Disallow /spaces/15891780*
Disallow /spaces/15891877*
Disallow /spaces/7611418*
Disallow /spaces/19074711*
Disallow /spaces/19003668*
Disallow /communities/

Other Records

Field Value
sitemap https://community.fightcrc.org/sitemap.xml