artificial-intelligence.cioapplications.com
robots.txt

Resource Scan

Scan Details

Site Domain artificial-intelligence.cioapplications.com
Base Domain cioapplications.com
Scan Status Ok
Last Scan2025-05-20T10:27:57+00:00
Next Scan 2025-06-19T10:27:57+00:00

Last Scan

Scanned2025-05-20T10:27:57+00:00
URL https://artificial-intelligence.cioapplications.com/robots.txt
Domain IPs 52.11.180.226
Response IP 52.11.180.226
Found Yes
Hash cb1958679c143490466a195c1ff10fb4ef11d1eb248d71d26085b80dbfbcb2e4
SimHash 3806db91c013

Groups

*

Rule Path
Disallow /admin/
Disallow /scripts/
Disallow /*.php$
Disallow /zlib/
Disallow /lib/
Disallow /utils/
Allow /magazines/*

googlebot

Product Comment
googlebot Googlebot
Rule Path
Disallow /admin/
Disallow /magazines/

googlebot-image

Product Comment
googlebot-image Googlebot
Rule Path
Disallow /admin/
Disallow /magazines/

mediapartners-google

Product Comment
mediapartners-google GoogleMedia Partners
Rule Path
Disallow /admin/
Disallow /magazines/

adsbot-google

Product Comment
adsbot-google Google Adsbot
Rule Path
Disallow /admin/
Disallow /magazines/

yandexbot
linkedinbot
twitterbot
googlebot-mobile

Product Comment
googlebot-mobile Google Mobile robot
Rule Path
Disallow /admin/
Disallow /magazines/

msnbot

Product Comment
msnbot MSN search bot
Rule Path
Disallow /admin/
Disallow /magazines/

slurp

Product Comment
slurp Yahoo
Rule Path
Disallow /admin/
Disallow /magazines/

msicrawler

Product Comment
msicrawler MS Internet Explorer for offline viewing
Rule Path
Disallow /admin/
Disallow /magazines/

baiduspider

Product Comment
baiduspider Baidu Search Engine
Rule Path
Disallow /admin/
Disallow /magazines/

bingbot

Product Comment
bingbot Bing Search Engine
Rule Path
Disallow /admin/
Disallow /magazines/

screaming frog seo spider

Product Comment
screaming frog seo spider Screaming Frog Tool
Rule Path
Disallow /admin/
Disallow /magazines/

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

yandexbot

Rule Path Comment
Disallow /admin/ -
Disallow /magazines/ Ahrefs Tool
Disallow /admin/ -
Disallow /magazines/ -

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cioapplications.com/cioapplicationnews_sitemap.xml
sitemap https://www.cioapplications.com/all_in_one_sitemap_main.xml
sitemap https://www.cioapplications.com/cioapplications_newnews_sitemap.xml
sitemap https://www.cioapplications.com/contributors_sitemap.xml
sitemap https://www.cioapplications.com/rankingxml_sitemap_new.xml
sitemap https://www.cioapplications.com/cioapplicationvendor_sitemap_new.xml

Comments

  • Allow AhrefsBot
  • Allow AhrefsSiteAudit