Log In Sign Up

haodingdan.com
robots.txt

Robots Exclusion Standard data for haodingdan.com

Resource Scan

Scan Details

Site Domain haodingdan.com
Base Domain haodingdan.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-21T23:37:11+00:00
Next Scan 2024-11-20T23:37:11+00:00

Last Successful Scan

Scanned2024-07-01T23:30:10+00:00
URL https://haodingdan.com/robots.txt
Redirect http://www.haodingdan.com/robots.txt
Redirect Domain www.haodingdan.com
Redirect Base haodingdan.com
Domain IPs 47.110.189.212
Redirect IPs 47.110.189.212
Response IP 47.110.189.212
Found Yes
Hash f09c8f0e3a2fd3941291fc92f25e237fd70e576ce1fe77d2f27e5e088dcb0857
SimHash a4d7c145c675

Groups

sogou web spider/4.0
sogou inst spider/4.0
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
baiduspider-ads
baiduspider-favo
baiduspider-cpro
bingbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
adsbot-google

Rule Path
Disallow /mine
Disallow /my
Disallow /serv
Disallow /help
Disallow /file/file_photo
Allow /order.html$
Disallow /order.html?*
Allow /order-p*.html$
Disallow /order-p*.html?*
Disallow /search_order/*.html?*&
Disallow /search_order.html?*&
Disallow /search_order/?*&
Disallow /search_factory.html?*&
Disallow /search_factory/?*&
Disallow /product/?*&
Disallow /search_factory/*.html?*&
Disallow /search_factory?*&
Allow /order/detail/*
Disallow /order/*?*&
Disallow /factory/*?area=%
Allow /factory/*?area
Disallow /factory/*?*

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.haodingdan.com/home/map.html
Back to top

Comments

  • allowed bots
  • ref: Google as http://www.google.com/bot.html
  • ref: Baidu as http://www.baidu.com/search/spider.html
  • ref: Bing as http://www.bing.com/bingbot.htm
  • ref: Sogou as http://www.sogou.com/docs/help/webmasters.htm#07
  • 360Spider ... really can't find any thing on 360 site as ref ...
  • also can't id it's IP by using Reverse DNS.
  • tell everyone else to go away
Back to top

Warnings

  • 1 invalid line.
Back to top