databento.com
robots.txt

Robots Exclusion Standard data for databento.com

Resource Scan

Scan Details

Site Domain databento.com
Base Domain databento.com
Scan Status Ok
Last Scan2024-10-12T21:12:37+00:00
Next Scan 2024-11-11T21:12:37+00:00

Last Scan

Scanned2024-10-12T21:12:37+00:00
URL https://databento.com/robots.txt
Domain IPs 18.155.68.51, 18.155.68.53, 18.155.68.66, 18.155.68.75
Response IP 18.155.68.51
Found Yes
Hash 58fa845c24ca1f783065520978f16fa04226381ce83d04b1619f1bf7499810c7
SimHash e900dc05eb93

Groups

*

Rule Path
Disallow /portal

Other Records

Field Value
sitemap https://www.databento.com/sitemap-index.xml.gz