docbao.io
robots.txt

Robots Exclusion Standard data for docbao.io

Resource Scan

Scan Details

Site Domain docbao.io
Base Domain docbao.io
Scan Status Ok
Last Scan2025-08-15T10:00:37+00:00
Next Scan 2025-08-29T10:00:37+00:00

Last Scan

Scanned2025-08-15T10:00:37+00:00
URL https://docbao.io/robots.txt
Redirect https://www.docbao.io/robots.txt
Redirect Domain www.docbao.io
Redirect Base docbao.io
Domain IPs 13.35.37.110, 13.35.37.119, 13.35.37.63, 13.35.37.77
Redirect IPs 13.35.37.110, 13.35.37.119, 13.35.37.63, 13.35.37.77, 2600:9000:213e:3800:1:46e0:ee80:93a1, 2600:9000:213e:4a00:1:46e0:ee80:93a1, 2600:9000:213e:6400:1:46e0:ee80:93a1, 2600:9000:213e:7e00:1:46e0:ee80:93a1, 2600:9000:213e:8c00:1:46e0:ee80:93a1, 2600:9000:213e:9600:1:46e0:ee80:93a1, 2600:9000:213e:a600:1:46e0:ee80:93a1, 2600:9000:213e:fe00:1:46e0:ee80:93a1
Response IP 13.35.37.77
Found Yes
Hash c69178f27924053c2ce899821210e71fe650a97e6745e0b692336645d3ca3036
SimHash 0c105a508573

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /xoa-tai-khoan

*

Rule Path
Allow /chinh-sach-bao-mat

*

Rule Path
Allow /dang-nhap

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

pinterest

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

instagram

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

whatsapp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

telegrambot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

viber

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

zalo

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://docbao.io/sitemap.xml

Comments

  • Allow all crawlers
  • Block all crawlers for /admin
  • Allow all crawlers
  • Sitemap
  • Crawl-delay
  • Allow Googlebot
  • Allow Bingbot
  • Allow Yandex
  • Allow Baidu
  • Allow DuckDuckBot
  • Allow Facebook
  • Allow Twitter
  • Allow LinkedIn
  • Allow Pinterest
  • Allow Instagram
  • Allow WhatsApp
  • Allow Telegram
  • Allow Viber
  • Allow Zalo