ciol.com
robots.txt

Robots Exclusion Standard data for ciol.com

Resource Scan

Scan Details

Site Domain ciol.com
Base Domain ciol.com
Scan Status Ok
Last Scan2024-06-08T13:36:01+00:00
Next Scan 2024-06-15T13:36:01+00:00

Last Scan

Scanned2024-06-08T13:36:01+00:00
URL https://ciol.com/robots.txt
Redirect https://www.ciol.com/robots.txt
Redirect Domain www.ciol.com
Redirect Base ciol.com
Domain IPs 104.26.2.24, 104.26.3.24, 172.67.69.33, 2606:4700:20::681a:218, 2606:4700:20::681a:318, 2606:4700:20::ac43:4521
Redirect IPs 104.26.2.24, 104.26.3.24, 172.67.69.33, 2606:4700:20::681a:218, 2606:4700:20::681a:318, 2606:4700:20::ac43:4521
Response IP 104.26.3.24
Found Yes
Hash 475ef63464d14c13151e96c5ef21116650f0591fda3c218202ddd1f1c882ddda
SimHash 800d9c60aed3

Groups

*

Rule Path
Disallow
Disallow /static/*

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ciol.com/webcontent-sitemap.xml
sitemap https://www.ciol.com/category-sitemap.xml
sitemap https://www.ciol.com/news-sitemap.xml