docs.cilium.io
robots.txt

Robots Exclusion Standard data for docs.cilium.io

Resource Scan

Scan Details

Site Domain docs.cilium.io
Base Domain cilium.io
Scan Status Ok
Last Scan2025-09-29T19:40:26+00:00
Next Scan 2025-10-29T19:40:26+00:00

Last Scan

Scanned2025-09-29T19:40:26+00:00
URL https://docs.cilium.io/robots.txt
Domain IPs 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78
Response IP 104.16.253.120
Found Yes
Hash 9c5396241e4776203b54749c23c842ac0e53a75355ce750c4b89c07a928b349e
SimHash 490c88708b93

Groups

*

Rule Path
Disallow /
Allow /en/stable
Allow /en/latest

Other Records

Field Value
sitemap https://docs.cilium.io/en/latest/_static/sitemap-index.xml