Log In Sign Up

cerbos.dev
robots.txt

Robots Exclusion Standard data for cerbos.dev

Resource Scan

Scan Details

Site Domain cerbos.dev
Base Domain cerbos.dev
Scan Status Ok
Last Scan2024-09-09T06:26:59+00:00
Next Scan 2024-10-09T06:26:59+00:00

Last Scan

Scanned2024-09-09T06:26:59+00:00
URL https://cerbos.dev/robots.txt
Redirect https://www.cerbos.dev/robots.txt
Redirect Domain www.cerbos.dev
Redirect Base cerbos.dev
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.142, 76.76.21.9
Response IP 76.76.21.61
Found Yes
Hash 3e85e713f00c1ceaaeb907d807027acbba088b8339832dcbde4c6de1a719dbe5
SimHash 6940d441c791

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /blog/tag/*

*

Rule Path
Disallow /blog/page/*
Back to top

Other Records

Field Value
sitemap https://www.cerbos.dev/sitemap.xml
Back to top

Comments

  • *
  • *
  • *
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top