Log In Sign Up

equirodi.it
robots.txt

Robots Exclusion Standard data for equirodi.it

Resource Scan

Scan Details

Site Domain equirodi.it
Base Domain equirodi.it
Scan Status Ok
Last Scan2024-11-06T05:14:19+00:00
Next Scan 2024-11-13T05:14:19+00:00

Last Scan

Scanned2024-11-06T05:14:19+00:00
URL https://equirodi.it/robots.txt
Domain IPs 176.31.142.40
Response IP 176.31.142.40
Found Yes
Hash 40fe6a1a2ca94e7dfe8d5d58edda2f2a56aae87703bb68dd237b56feddb02f92
SimHash 04258012c652

Groups

*

Rule Path
Disallow /blog/
Disallow /blog-fr/
Disallow /blog-nl/
Disallow /cheval/
Disallow /horse/
Disallow /caballo/
Disallow /impression-annonce/
Disallow /imprimir-anuncio/
Disallow /print-ad/
Disallow /fr/impression-annonce/
Disallow /be/impression-annonce/
Disallow /ch/impression-annonce/
Disallow /ca/impression-annonce/
Disallow /redirect/
Disallow /fr/redirect/
Disallow /ws/
Disallow /cms/
Disallow /adminads/
Disallow /adminmembers/
Disallow /member/details/
Disallow /member/
Disallow /membre/
Disallow /miembro/
Disallow /lid/
Disallow /ca/membre/
Disallow /fr/membre/
Disallow /be/membre/
Disallow /ch/membre/
Disallow /ca/member/details/
Disallow /fr/member/details/
Disallow /be/member/details/
Disallow /ch/member/details/
Disallow /member/localisation/
Disallow /ca/member/localisation/
Disallow /fr/member/localisation/
Disallow /be/member/localisation/
Disallow /ch/member/localisation/
Disallow /fr/img/
Disallow /fr/blog/
Disallow /fr/mailing/
Disallow /suisse/
Disallow /belgique/
Disallow /canada/
Disallow /poneys/
Disallow /chevaux/
Disallow /transport-chevaux/
Disallow /ads_docs/
Disallow /panier
Allow /panier-a-bandes-cheval
Disallow /postadnew/
Disallow /postad/
Disallow /msg/
Disallow /boutique/
Disallow /ma-sellerie/
Disallow /ajaxpb/get/format/
Disallow */ref-*.htm$
Disallow */docs/get.php*$
Disallow *idu%3D*$
Disallow *att%3D*$
Disallow /recherche/*
Disallow *occasion_seulement%3D1$
Disallow *ni%3D1$
Allow /

sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou-test-spider/4.0 (compatible; msie 5.5; windows 98)
sogou spider
sogou pic agent
sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm !07)
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm !07)
sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm !07)
Rule Path
Disallow /

mj12bot
ichiro
nutch
trovitbot
turnitinbot
ia_archiver
naverbot
yeti
youdaobot
cloudservermarketspider
haosouspider
blexbot

Rule Path
Disallow /

megaindex.ru
megaindex.com
mozilla/5.0 (compatible; megaindex.ru/2.0; +http://megaindex.com/crawler)

Rule Path
Disallow /

mail.ru_bot/2.0
mail.ru
mail.ru
mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.equirodi.com/sitemap.xml
Back to top

Comments

  • com
  • Disallow: /en/
  • stop bots
  • User-agent: Baiduspider
  • User-agent: Baiduspider-video
  • User-agent: Baiduspider-image
  • User-agent: Yandex
  • User-agent: YandexBot
  • https://megaindex.com/crawler
Back to top