doushangzhijian.com
robots.txt

Robots Exclusion Standard data for doushangzhijian.com

Resource Scan

Scan Details

Site Domain doushangzhijian.com
Base Domain doushangzhijian.com
Scan Status Ok
Last Scan2024-09-10T17:31:27+00:00
Next Scan 2024-10-10T17:31:27+00:00

Last Scan

Scanned2024-09-10T17:31:27+00:00
URL https://doushangzhijian.com/robots.txt
Redirect https://www.doushangzhijian.com/robots.txt
Redirect Domain www.doushangzhijian.com
Redirect Base doushangzhijian.com
Domain IPs 120.77.0.254
Redirect IPs 120.77.0.254
Response IP 120.77.0.254
Found Yes
Hash 363bae1b45539b1aedb769b8d9ae47999ac90444030cb9642d0d4d9d1f5477c8
SimHash 6102fba25512

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

psbot

Rule Path
Disallow /
Disallow /addons/
Disallow /api/
Disallow /app/
Disallow /attachment/
Disallow /common/
Disallow /data/
Disallow /framework/
Disallow /home/
Disallow /images/
Disallow /min.ykmy.cn/
Disallow /payment/
Disallow /resource/
Disallow /web/

*

Rule Path
Disallow /*.php
Disallow /*.asp

Comments

  • robots.txt generated at http://tool.chinaz.com/robots/