caixinglobal.com
robots.txt

Robots Exclusion Standard data for caixinglobal.com

Resource Scan

Scan Details

Site Domain caixinglobal.com
Base Domain caixinglobal.com
Scan Status Ok
Last Scan2024-09-28T08:22:23+00:00
Next Scan 2024-10-05T08:22:23+00:00

Last Scan

Scanned2024-09-28T08:22:23+00:00
URL https://caixinglobal.com/robots.txt
Redirect https://www.caixinglobal.com/robots.txt
Redirect Domain www.caixinglobal.com
Redirect Base caixinglobal.com
Domain IPs 138.2.106.225
Redirect IPs 129.227.66.131, 129.227.66.132, 129.227.66.133, 129.227.66.134
Response IP 129.227.66.133
Found Yes
Hash de78f9500921d3af25f4e88ddbac48769195f5274976b57960805d0175d85a65
SimHash 8124d800a152

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Block Common Crawl (CCBot)