couchbase.com
robots.txt

Robots Exclusion Standard data for couchbase.com

Resource Scan

Scan Details

Site Domain couchbase.com
Base Domain couchbase.com
Scan Status Ok
Last Scan2024-11-08T19:35:05+00:00
Next Scan 2024-12-08T19:35:05+00:00

Last Scan

Scanned2024-11-08T19:35:05+00:00
URL https://couchbase.com/robots.txt
Domain IPs 104.198.5.51
Response IP 104.198.5.51
Found Yes
Hash 8aab1c0c8cf9d20d086eb2d8f347c175c6e9fc93bfa82de0cdaa7d505c02bd82
SimHash e30cdde87d83

Groups

mauibot

Rule Path
Disallow /forums/

semrushbot

Rule Path
Disallow /forums/

ahrefsbot

Rule Path
Disallow /forums/

blexbot

Rule Path
Disallow /forums/

seo spider

Rule Path
Disallow /forums/

*

Rule Path
Disallow /forums/admin/
Disallow /forums/auth/
Disallow /forums/assets/browser-update*.js
Disallow /forums/email/
Disallow /forums/session
Disallow /forums/user-api-key
Disallow /forums/*?api_key*
Disallow /forums/*?*api_key*
Disallow /forums/badges
Disallow /forums/u/
Disallow /forums/my
Disallow /forums/search
Disallow /forums/tag/*/l
Disallow /forums/g
Disallow /forums/t/*/*.rss
Disallow /forums/c/*.rss
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /forums/admin/
Disallow /forums/auth/
Disallow /forums/assets/browser-update*.js
Disallow /forums/email/
Disallow /forums/session
Disallow /forums/user-api-key
Disallow /forums/*?api_key*
Disallow /forums/*?*api_key*

Other Records

Field Value
sitemap https://www.couchbase.com/sitemap_index.xml
sitemap https://www.couchbase.com/blog/sitemap_index.xml

Comments

  • Some values copied over from Forums robots.txt (https://www.couchbase.com/forums/robots.txt)
  • End Forums Robots.txt includes