couchbase.com
robots.txt

Robots Exclusion Standard data for couchbase.com

Resource Scan

Scan Details

Site Domain couchbase.com
Base Domain couchbase.com
Scan Status Ok
Last Scan2024-06-19T19:33:20+00:00
Next Scan 2024-07-19T19:33:20+00:00

Last Scan

Scanned2024-06-19T19:33:20+00:00
URL https://couchbase.com/robots.txt
Redirect https://www.couchbase.com/robots.txt
Redirect Domain www.couchbase.com
Redirect Base couchbase.com
Domain IPs 199.193.192.229
Redirect IPs 2600:1413:b000:1d::17d1:2e89, 2600:1413:b000:1d::17d1:2e91, 96.17.180.43, 96.17.180.50
Response IP 96.17.180.16
Found Yes
Hash 8aab1c0c8cf9d20d086eb2d8f347c175c6e9fc93bfa82de0cdaa7d505c02bd82
SimHash e30cdde87d83

Groups

mauibot

Rule Path
Disallow /forums/

semrushbot

Rule Path
Disallow /forums/

ahrefsbot

Rule Path
Disallow /forums/

blexbot

Rule Path
Disallow /forums/

seo spider

Rule Path
Disallow /forums/

*

Rule Path
Disallow /forums/admin/
Disallow /forums/auth/
Disallow /forums/assets/browser-update*.js
Disallow /forums/email/
Disallow /forums/session
Disallow /forums/user-api-key
Disallow /forums/*?api_key*
Disallow /forums/*?*api_key*
Disallow /forums/badges
Disallow /forums/u/
Disallow /forums/my
Disallow /forums/search
Disallow /forums/tag/*/l
Disallow /forums/g
Disallow /forums/t/*/*.rss
Disallow /forums/c/*.rss
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /forums/admin/
Disallow /forums/auth/
Disallow /forums/assets/browser-update*.js
Disallow /forums/email/
Disallow /forums/session
Disallow /forums/user-api-key
Disallow /forums/*?api_key*
Disallow /forums/*?*api_key*

Other Records

Field Value
sitemap https://www.couchbase.com/sitemap_index.xml
sitemap https://www.couchbase.com/blog/sitemap_index.xml

Comments

  • Some values copied over from Forums robots.txt (https://www.couchbase.com/forums/robots.txt)
  • End Forums Robots.txt includes