cioapplications.com
robots.txt

Robots Exclusion Standard data for cioapplications.com

Resource Scan

Scan Details

Site Domain cioapplications.com
Base Domain cioapplications.com
Scan Status Ok
Last Scan2024-10-26T17:16:28+00:00
Next Scan 2024-11-02T17:16:28+00:00

Last Scan

Scanned2024-10-26T17:16:28+00:00
URL https://cioapplications.com/robots.txt
Redirect https://www.cioapplications.com/robots.txt
Redirect Domain www.cioapplications.com
Redirect Base cioapplications.com
Domain IPs 52.11.180.226
Redirect IPs 52.11.180.226
Response IP 52.11.180.226
Found Yes
Hash db5a00b7e4abefc1482cd5ad4e5c327a5ed8ef1add16a35be2058125504dc70e
SimHash 3806db91c413

Groups

*

Rule Path
Disallow /admin/
Disallow /scripts/
Disallow /*.php$
Disallow /zlib/
Disallow /lib/
Disallow /utils/
Allow /magazines/*

googlebot

Product Comment
googlebot Googlebot
Rule Path
Disallow /admin/
Disallow /magazines/

googlebot-image

Product Comment
googlebot-image Googlebot
Rule Path
Disallow /admin/
Disallow /magazines/

mediapartners-google

Product Comment
mediapartners-google GoogleMedia Partners
Rule Path
Disallow /admin/
Disallow /magazines/

adsbot-google

Product Comment
adsbot-google Google Adsbot
Rule Path
Disallow /admin/
Disallow /magazines/

yandexbot
linkedinbot
twitterbot
googlebot-mobile

Product Comment
googlebot-mobile Google Mobile robot
Rule Path
Disallow /admin/
Disallow /magazines/

msnbot

Product Comment
msnbot MSN search bot
Rule Path
Disallow /admin/
Disallow /magazines/

slurp

Product Comment
slurp Yahoo
Rule Path
Disallow /admin/
Disallow /magazines/

msicrawler

Product Comment
msicrawler MS Internet Explorer for offline viewing
Rule Path
Disallow /admin/
Disallow /magazines/

baiduspider

Product Comment
baiduspider Baidu Search Engine
Rule Path
Disallow /admin/
Disallow /magazines/

bingbot

Product Comment
bingbot Bing Search Engine
Rule Path
Disallow /admin/
Disallow /magazines/

screaming frog seo spider

Product Comment
screaming frog seo spider Screaming Frog Tool
Rule Path
Disallow /admin/
Disallow /magazines/

ahrefsbot

Product Comment
ahrefsbot Ahrefs Tool
Rule Path
Disallow /admin/
Disallow /magazines/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cioapplications.com/cioapplicationnews_sitemap.xml
sitemap https://www.cioapplications.com/all_in_one_sitemap_main.xml
sitemap https://www.cioapplications.com/cioapplications_newnews_sitemap.xml
sitemap https://www.cioapplications.com/contributors_sitemap.xml