Log In Sign Up

cioreview.com
robots.txt

Robots Exclusion Standard data for cioreview.com

Resource Scan

Scan Details

Site Domain cioreview.com
Base Domain cioreview.com
Scan Status Ok
Last Scan2024-10-28T11:03:01+00:00
Next Scan 2024-11-04T11:03:01+00:00

Last Scan

Scanned2024-10-28T11:03:01+00:00
URL https://cioreview.com/robots.txt
Redirect https://www.cioreview.com/robots.txt
Redirect Domain www.cioreview.com
Redirect Base cioreview.com
Domain IPs 34.237.57.74
Redirect IPs 34.237.57.74
Response IP 34.237.57.74
Found Yes
Hash cfb9529c46f703220970595369a4c7b5adcf97849d2f3792bd6848714baa56a4
SimHash 4959ca92f791

Groups

googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google
mediapartners-google
adsbot-google-mobile-apps
bingbot
msnbot
slurp
yandex
duckduckbot

Rule Path
Allow /

screaming frog seo spider
ahrefsbot

Rule Path
Allow /

yandexbot
*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.cioreview.com/cionews_sitemap.xml
sitemap https://www.cioreview.com/article_sitemap.xml
sitemap https://www.cioreview.com/all_in_one_sitemap_main.xml
sitemap https://www.cioreview.com/cioreview_newnews_sitemap.xml
Back to top

Comments

  • Allow major search engine bots
  • Allow specific tools
  • Block all other bots
Back to top

Warnings

  • 2 invalid lines.
Back to top