Log In Sign Up

equishopping.com
robots.txt

Robots Exclusion Standard data for equishopping.com

Resource Scan

Scan Details

Site Domain equishopping.com
Base Domain equishopping.com
Scan Status Ok
Last Scan2024-11-05T08:53:01+00:00
Next Scan 2024-11-12T08:53:01+00:00

Last Scan

Scanned2024-11-05T08:53:01+00:00
URL https://equishopping.com/robots.txt
Redirect https://www.equishopping.com/robots.txt
Redirect Domain www.equishopping.com
Redirect Base equishopping.com
Domain IPs 176.31.142.40
Redirect IPs 176.31.142.40
Response IP 176.31.142.40
Found Yes
Hash e69be26525602a47011df938781134547620ea3d70bad13955e606d6cc214fa4
SimHash 1841c043c273

Groups

*

Rule Path
Disallow /function
Disallow function
Allow /

sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou-test-spider/4.0 (compatible; msie 5.5; windows 98)
sogou spider
sogou pic agent
sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm !07)
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm !07)
Rule Path
Disallow /

mj12bot
ichiro
baiduspider
baiduspider-video
baiduspider-image
nutch
trovitbot
turnitinbot
ia_archiver
yandex
yandexbot
naverbot
yeti
youdaobot
cloudservermarketspider
haosouspider
megaindex.ru
megaindex.com
mozilla/5.0 (compatible; megaindex.ru/2.0; +http://megaindex.com/crawler)
ahrefsbot

Rule Path
Disallow /

mail.ru_bot/2.0
mail.ru
mail.ru
mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /*ni=1$
  • Disallow: /offre-*.htm
  • Disallow: /produit-marchand-*.htm
  • stop bots
Back to top