cheneyfreepress.com
robots.txt

Robots Exclusion Standard data for cheneyfreepress.com

Resource Scan

Scan Details

Site Domain cheneyfreepress.com
Base Domain cheneyfreepress.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-10T22:11:03+00:00
Next Scan 2024-12-09T22:11:03+00:00

Last Successful Scan

Scanned2024-05-14T13:57:26+00:00
URL https://cheneyfreepress.com/robots.txt
Redirect https://www.cheneyfreepress.com/robots.txt
Redirect Domain www.cheneyfreepress.com
Redirect Base cheneyfreepress.com
Domain IPs 35.165.62.155
Redirect IPs 35.165.62.155
Response IP 35.165.62.155
Found Yes
Hash e38cebb282418cd07b066d3cb0b9324a0d0108d70068bc3c114962ca4c8fa1ee
SimHash 222f5de12611

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezoicbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

cloudflare-alwaysonline

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot-udiscovery

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap HTTPS://www.cheneyfreepress.com/sitemap_index.xml