databrio.com
robots.txt

Robots Exclusion Standard data for databrio.com

Resource Scan

Scan Details

Site Domain databrio.com
Base Domain databrio.com
Scan Status Ok
Last Scan2025-11-04T12:47:34+00:00
Next Scan 2025-12-04T12:47:34+00:00

Last Scan

Scanned2025-11-04T12:47:34+00:00
URL https://databrio.com/robots.txt
Domain IPs 104.21.24.27, 172.67.216.125, 2606:4700:3035::6815:181b, 2606:4700:3035::ac43:d87d
Response IP 104.21.24.27
Found Yes
Hash 10bf920eac169e9ca03eb57e0c7ef3d8bb5f0f88521e5159971b651120c96949
SimHash 4851db036413

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

robozilla

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

gemini

Rule Path
Allow /

google-extended

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /cgi-bin/
Disallow /wp-admin/

Other Records

Field Value
sitemap https://databrio.com/sitemap_index.xml

Comments

  • Allow AI tools
  • Disallow all others