hexun.com
robots.txt

Robots Exclusion Standard data for hexun.com

Resource Scan

Scan Details

Site Domain hexun.com
Base Domain hexun.com
Scan Status Ok
Last Scan2024-09-28T17:11:14+00:00
Next Scan 2024-10-05T17:11:14+00:00

Last Scan

Scanned2024-09-28T17:11:14+00:00
URL https://www.hexun.com/robots.txt
Domain IPs 1.56.98.203, 101.69.99.10, 113.194.50.179, 116.148.232.186, 116.196.152.184, 119.188.123.187, 123.6.40.212, 211.97.84.77, 221.204.43.248, 36.249.64.128, 42.177.83.92, 58.250.127.156, 60.28.220.199, 61.240.220.8, 61.241.148.62
Response IP 211.97.84.77
Found Yes
Hash c224a95e9adb805a19c6ce248552ed7894b07313adc3a332a2526b5432400cb1
SimHash 0818e2720b93

Groups

*

Rule Path
Allow /
Disallow /Comment/GetComment.do?*

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /