mke.com.bd
robots.txt

Robots Exclusion Standard data for mke.com.bd

Resource Scan

Scan Details

Site Domain mke.com.bd
Base Domain mke.com.bd
Scan Status Ok
Last Scan2026-02-27T04:42:40+00:00
Next Scan 2026-03-29T04:42:40+00:00

Last Scan

Scanned2026-02-27T04:42:40+00:00
URL https://mke.com.bd/robots.txt
Domain IPs 104.21.37.51, 172.67.203.248, 2606:4700:3037::6815:2533, 2606:4700:3037::ac43:cbf8
Response IP 172.67.203.248
Found Yes
Hash 2ba1696bc5a77d9cec1403cc1180b34b658f9ace4a15343a0b896b15926e44ee
SimHash 413cce02e7b2

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

yandex

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

curl

Rule Path
Disallow /

*

Rule Path
Disallow /backoffice/
Disallow /checkout/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /index.php/
Disallow /app/
Disallow /lib/
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /*SID%3D
Disallow /*.php$
Disallow /*?

Other Records

Field Value
sitemap https://mke.com.bd/pub/media/sitemap/sitemap.xml

Comments

  • ---------- Allow major search engines to crawl freely ----------
  • ---------- Block abusive or unnecessary bots ----------
  • ---------- Default rules for all other bots ----------