hitoor.com
robots.txt

Robots Exclusion Standard data for hitoor.com

Resource Scan

Scan Details

Site Domain hitoor.com
Base Domain hitoor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T03:10:22+00:00
Next Scan 2024-11-18T03:10:22+00:00

Last Successful Scan

Scanned2024-06-29T03:04:53+00:00
URL https://www.hitoor.com/robots.txt
Domain IPs 163.181.160.235, 163.181.160.236, 163.181.160.237, 163.181.160.238, 163.181.160.239, 163.181.160.240, 163.181.160.241, 163.181.160.242
Response IP 163.181.164.239
Found Yes
Hash 2e001509c72ba79699912ddbc2b0e4351d0f289df3692e50923b2730e386a77e
SimHash c64d65a6cb07

Groups

baiduspider

Rule Path
Allow /
Disallow *?channel*
Disallow /a%3Cem*
Disallow *.php*
Disallow *.asp*
Disallow /data/
Disallow /admin/
Disallow /admin_aspcms/
Disallow /fckeditor/
Disallow /item/
Disallow /install/
Disallow /plug/
Disallow /plus/

baiduspider-image

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

youdaobot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sogou inst spider

Rule Path
Allow /

sogou spider2

Rule Path
Allow /

sogou blog

Rule Path
Allow /

sogou news spider

Rule Path
Allow /

sogou orion spider

Rule Path
Allow /

jikespider

Rule Path
Allow /

sosospider

Rule Path
Allow /