browserbase.com
robots.txt

Robots Exclusion Standard data for browserbase.com

Resource Scan

Scan Details

Site Domain browserbase.com
Base Domain browserbase.com
Scan Status Ok
Last Scan2025-11-07T11:04:17+00:00
Next Scan 2025-12-07T11:04:17+00:00

Last Scan

Scanned2025-11-07T11:04:17+00:00
URL https://browserbase.com/robots.txt
Redirect https://www.browserbase.com/robots.txt
Redirect Domain www.browserbase.com
Redirect Base browserbase.com
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.193, 76.76.21.93
Response IP 66.33.60.193
Found Yes
Hash 09356101f5e0dfb7cf9cb1b6e0a39e94dc0229b02b73356eb3a7781c8c09cfe2
SimHash 8a080d324da2

Groups

*

Rule Path
Allow /
Disallow /_next/
Disallow /cms-studio/
Disallow /website-api/

Other Records

Field Value
sitemap https://www.browserbase.com/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html