bds-hanoi.info
robots.txt

Robots Exclusion Standard data for bds-hanoi.info

Resource Scan

Scan Details

Site Domain bds-hanoi.info
Base Domain bds-hanoi.info
Scan Status Ok
Last Scan2025-08-29T07:02:30+00:00
Next Scan 2025-09-28T07:02:30+00:00

Last Scan

Scanned2025-08-29T07:02:30+00:00
URL https://bds-hanoi.info/robots.txt
Domain IPs 66.29.148.6
Response IP 66.29.148.6
Found Yes
Hash f9b7ddc749884d2b38368a8dbad9ed8032ffbf11c4e71c4b768758a363f2eafc
SimHash 38509b03e5b3

Groups

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

googlebot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou

Rule Path
Disallow /

exabot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • Allow Ahrefs bots (for DR update)
  • Block all other bots (including Google and SEO tools)