kanchivml.com
robots.txt

Robots Exclusion Standard data for kanchivml.com

Resource Scan

Scan Details

Site Domain kanchivml.com
Base Domain kanchivml.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-16T03:17:45+00:00
Next Scan 2024-07-16T03:17:45+00:00

Last Successful Scan

Scanned2024-04-25T03:15:44+00:00
URL https://kanchivml.com/robots.txt
Domain IPs 104.26.0.55, 104.26.1.55, 172.67.68.73, 2606:4700:20::681a:137, 2606:4700:20::681a:37, 2606:4700:20::ac43:4449
Response IP 104.26.1.55
Found Yes
Hash a3a8526fa9a9410c1bfd2715a69864bd56c92f4fc49e8d28a271cd55ba16fdea
SimHash 487d7b48c71a

Groups

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /cart/*
Disallow /myaccount/*
Disallow /pgcallback/*
Disallow /search-results/*
Disallow /liveshow_sale/*
Disallow /*live*

baidu spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

alexa crawler

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

pingdom bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

curl

Rule Path
Disallow /
Disallow /search
Disallow /en/search
Disallow /*?showType
Disallow /*?categoryCode
Disallow /*?sort
Disallow /*?pagetype
Disallow /*?q
Allow /*?PageSpeed
Disallow /*?currentPosition
Disallow /*?text&showType&sort
Disallow /ssladmin/
Disallow /sslomm/
Disallow /%26s2%3Dym
Disallow /catalogservlet?categoryid=
Disallow /checkout/multi/
Disallow /crm.
Disallow /r.srvtrck.com/v1/
Disallow /wishlist/addorremovewishlist/

emailcollector

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

xenu's link sleuth

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

nmap

Rule Path
Disallow /

download demon

Rule Path
Disallow /

nikto

Rule Path
Disallow /

nessus

Rule Path
Disallow /

fake googlebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://kanchivml.com/pub/media/sitemap.xml

Comments

  • Disallow various unwanted or malicious bots
  • Sitemap Declaration

Warnings

  • 2 invalid lines.