cfweekly.com
robots.txt

Robots Exclusion Standard data for cfweekly.com

Resource Scan

Scan Details

Site Domain cfweekly.com
Base Domain cfweekly.com
Scan Status Ok
Last Scan2025-09-15T08:25:59+00:00
Next Scan 2025-09-22T08:25:59+00:00

Last Scan

Scanned2025-09-15T08:25:59+00:00
URL https://cfweekly.com/robots.txt
Domain IPs 2a02:4780:15:3b4c:b562:9a00:9955:c550, 2a02:4780:16:1b04:1df9:cd6e:a9b5:ef9e, 84.32.84.25, 84.32.84.40
Response IP 191.101.228.32
Found Yes
Hash a53d84ad0008058e019199badaf8cf3e80b029ccbd95c18d39117aab6c101201
SimHash 481408708333

Groups

*

Rule Path
Allow /
Disallow /tdb_templates/
Disallow /*.html$
Disallow /*/feed/

Other Records

Field Value
sitemap https://cfweekly.com/sitemap.xml