Log In Sign Up

docs.bmc.com
robots.txt

Robots Exclusion Standard data for docs.bmc.com

Resource Scan

Scan Details

Site Domain docs.bmc.com
Base Domain bmc.com
Scan Status Ok
Last Scan2025-12-29T07:12:07+00:00
Next Scan 2026-01-28T07:12:07+00:00

Last Scan

Scanned2025-12-29T07:12:07+00:00
URL https://docs.bmc.com/robots.txt
Domain IPs 178.32.198.83, 92.222.135.245
Response IP 92.222.135.245
Found Yes
Hash 226d58dd5f4513fc0c73d19de5469686ecd7128ace5fb936298c80cf65f7a205
SimHash 217645308525

Groups

*

Rule Path
Disallow */viewattachrev/
Disallow */viewrev/
Disallow */pdf/
Disallow */tex/
Disallow */edit/
Disallow */create/
Disallow */inline/
Disallow */preview/
Disallow */save/
Disallow */saveandcontinue/
Disallow */rollback/
Disallow */deleteversions/
Disallow */cancel/
Disallow */delete/
Disallow */deletespace/
Disallow */undelete/
Disallow */reset/
Disallow */register/
Disallow */propupdate/
Disallow */propadd/
Disallow */propdisable/
Disallow */propenable/
Disallow */propdelete/
Disallow */objectadd/
Disallow */commentadd/
Disallow */commentsave/
Disallow */objectsync/
Disallow */objectremove/
Disallow */attach/
Disallow */upload/
Disallow */download/
Disallow */temp/
Disallow */downloadrev/
Disallow */dot/
Disallow */svg/
Disallow */delattachment/
Disallow */skin/
Disallow */jsx/
Disallow */ssx/
Disallow */login/
Disallow */loginsubmit/
Disallow */loginerror/
Disallow */logout/
Disallow */charting/
Disallow */lock/
Disallow */redirect/
Disallow */admin/
Disallow */export/
Disallow */import/
Disallow */get/
Disallow */distribution/
Disallow */imagecaptcha/
Disallow */unknown/
Disallow */webjars/
Disallow */resources/
Disallow */Sandbox/
Disallow */Admin/
Disallow */Stats/
Disallow */Panels/
Disallow */asyncrenderer/uix/*Panel*
Disallow */Main/Search
Disallow */XWiki/XWikiGuest
Disallow */XWiki/superadmin
Disallow /*?*xpage=*
Disallow */view/*?*viewer=*
Disallow /xwiki/rest/
Allow /xwiki/*/download/*.png$
Allow /xwiki/*/download/*.jpg$
Allow /xwiki/*/download/*.jpeg$
Allow /xwiki/*/download/*.gif$

googlebot

Rule Path
Allow */jsx/
Allow */get/*?*xpage=plain*
Allow */webjars/
Allow */ssx/
Allow */charting/
Allow */dot/
Allow */svg/
Allow */download/*.png
Allow */download/*.jpg
Allow */download/*.jpeg
Allow */download/*.gif
Allow */download/*.svg
Allow */skin/
Allow */resources/
Disallow */asyncrenderer/uix/*Panel*
Disallow */jsx/*Panel*
Disallow */ssx/*Panel*
Disallow */viewattachrev/
Disallow */viewrev/
Disallow */pdf/
Disallow */tex/
Disallow */edit/
Disallow */create/
Disallow */inline/
Disallow */preview/
Disallow */save/
Disallow */saveandcontinue/
Disallow */rollback/
Disallow */deleteversions/
Disallow */cancel/
Disallow */delete/
Disallow */deletespace/
Disallow */undelete/
Disallow */reset/
Disallow */register/
Disallow */propupdate/
Disallow */propadd/
Disallow */propdisable/
Disallow */propenable/
Disallow */propdelete/
Disallow */objectadd/
Disallow */commentadd/
Disallow */commentsave/
Disallow */objectsync/
Disallow */objectremove/
Disallow */attach/
Disallow */upload/
Disallow */download/
Disallow */temp/
Disallow */downloadrev/
Disallow */delattachment/
Disallow */login/
Disallow */loginsubmit/
Disallow */loginerror/
Disallow */logout/
Disallow */lock/
Disallow */redirect/
Disallow */admin/
Disallow */export/
Disallow */import/
Disallow */get/
Disallow */distribution/
Disallow */imagecaptcha/
Disallow */unknown/
Disallow */Sandbox/
Disallow */Admin/
Disallow */Stats/
Disallow */Panels/
Disallow */Main/Search
Disallow */XWiki/XWikiGuest
Disallow */XWiki/superadmin
Disallow /*?*xpage=*
Disallow /*?*viewer=*
Disallow /xwiki/rest/
Allow /xwiki/*/download/*.png$
Allow /xwiki/*/download/*.jpg$
Allow /xwiki/*/download/*.jpeg$
Allow /xwiki/*/download/*.gif$
Back to top

Comments

  • By default, all web crawlers are denied access to non-view actions and UI resources (images, js, css)
  • Well known application (non-content) locations.
  • We're not interested in rendering and indexing panels.
  • XWiki virtual users that do not have profile pages. Avoid unnecessary 404 requests/errors.
  • Avoid crawling unnecesary UI elements that are not relevant for indexing and can even cause loops (like pdfoptions, etc.)
  • Index only the main page content, all other viewers are not relevant for idexing.
  • Don't index the REST API.
  • For images uploaded as attachments inside wiki pages
  • Googlebot uses a headless browser to fully render a page before indexing, so the UI resources are relevant and actually needed.
  • JS
  • CSS
  • Images
  • A bit of everything
  • We're not interested in rendering and indexing panels.
  • All other rules stay the same for Googlebot. We seem to have to add them or they will default to Allow and not inherit from the generic rules.
  • Well known application (non-content) locations.
  • XWiki virtual users that do not have profile pages. Avoid unnecessary 404 requests/errors.
  • Avoid crawling unnecesary UI elements that are not relevant for indexing and can even cause loops (like pdfoptions, etc.)
  • Index only the main page content, all other viewers are not relevant for idexing.
  • Don't index the REST API.
  • For images uploaded as attachments inside wiki pages
Back to top