datadog.com
robots.txt

Robots Exclusion Standard data for datadog.com

Resource Scan

Scan Details

Site Domain datadog.com
Base Domain datadog.com
Scan Status Ok
Last Scan2024-06-04T04:03:51+00:00
Next Scan 2024-07-04T04:03:51+00:00

Last Scan

Scanned2024-06-04T04:03:51+00:00
URL https://datadog.com/robots.txt
Redirect https://www.datadoghq.com/robots.txt
Redirect Domain www.datadoghq.com
Redirect Base datadoghq.com
Domain IPs 13.225.4.54, 13.225.4.66, 13.225.4.76, 13.225.4.91
Redirect IPs 108.156.133.127, 108.156.133.19, 108.156.133.47, 108.156.133.77, 2600:9000:2755:1a00:0:fa93:80c0:93a1, 2600:9000:2755:4200:0:fa93:80c0:93a1, 2600:9000:2755:4a00:0:fa93:80c0:93a1, 2600:9000:2755:5e00:0:fa93:80c0:93a1, 2600:9000:2755:7e00:0:fa93:80c0:93a1, 2600:9000:2755:9600:0:fa93:80c0:93a1, 2600:9000:2755:a200:0:fa93:80c0:93a1, 2600:9000:2755:a800:0:fa93:80c0:93a1
Response IP 108.156.133.19
Found Yes
Hash 8b6dc8d002d02516d9e5018a9ca09c2111e8a17640b01daf799ab502cdd0cf70
SimHash 780845e4b214

Groups

*

Rule Path
Disallow /pdf/
Disallow /meta/
Disallow /style/

Other Records

Field Value
sitemap https://www.datadoghq.com/sitemap.xml
sitemap https://www.datadoghq.com/en/sitemap.xml
sitemap https://www.datadoghq.com/es/sitemap.xml
sitemap https://www.datadoghq.com/ja/sitemap.xml
sitemap https://www.datadoghq.com/fr/sitemap.xml
sitemap https://www.datadoghq.com/de/sitemap.xml
sitemap https://www.datadoghq.com/it/sitemap.xml
sitemap https://www.datadoghq.com/ko/sitemap.xml
sitemap https://www.datadoghq.com/pt/sitemap.xml

Comments

  • Sitemaps