kandos.lk
robots.txt

Robots Exclusion Standard data for kandos.lk

Resource Scan

Scan Details

Site Domain kandos.lk
Base Domain kandos.lk
Scan Status Ok
Last Scan2026-02-04T08:07:14+00:00
Next Scan 2026-03-06T08:07:14+00:00

Last Scan

Scanned2026-02-04T08:07:14+00:00
URL https://kandos.lk/robots.txt
Domain IPs 209.74.67.130
Response IP 209.74.67.130
Found Yes
Hash c4ad89db4dc95fd21888c3f27fda5e16d0550fc662d65b945ab73430bdd86f82
SimHash 4c126c51c697

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /checkout/
Disallow /login/
Disallow /signup/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://kandos.lk/sitemap.xml

Comments

  • Kandos Chocolates - robots.txt
  • https://kandos.lk/robots.txt
  • Crawl-delay for all bots
  • Specific bots
  • Sitemap location