xwiki.com
robots.txt

Robots Exclusion Standard data for xwiki.com

Resource Scan

Scan Details

Site Domain xwiki.com
Base Domain xwiki.com
Scan Status Ok
Last Scan2024-09-20T11:10:06+00:00
Next Scan 2024-10-20T11:10:06+00:00

Last Scan

Scanned2024-09-20T11:10:06+00:00
URL https://xwiki.com/robots.txt
Domain IPs 92.222.135.230
Response IP 92.222.135.230
Found Yes
Hash 307785294ec8526fdde6d3a3a81338aaf1ccf9cc1cae53abd6b3ab74d9dc62df
SimHash 406163adefbe

Groups

*

Rule Path
Disallow /xwiki/bin/xmlrpc/
Disallow /xwiki/bin/pdf/
Disallow /xwiki/bin/edit/
Disallow /xwiki/bin/create/
Disallow /xwiki/bin/inline/
Disallow /xwiki/bin/preview/
Disallow /xwiki/bin/save/
Disallow /xwiki/bin/cancel/
Disallow /xwiki/bin/delete/
Disallow /xwiki/bin/register/
Disallow /xwiki/bin/propupdate/
Disallow /xwiki/bin/propadd/
Disallow /xwiki/bin/propdelete/
Disallow /xwiki/bin/commentadd/
Disallow /xwiki/bin/objectremove/
Disallow /xwiki/bin/attach/
Disallow /xwiki/bin/upload/
Disallow /xwiki/bin/download/
Disallow /xwiki/bin/dot/
Disallow /xwiki/bin/delattachment/
Disallow /xwiki/bin/login/
Disallow /xwiki/bin/loginerror/
Disallow /xwiki/bin/logout/
Disallow /xwiki/bin/status/
Disallow /xwiki/bin/lifeblog/
Disallow /xwiki/bin/viewrev/
Disallow /xwiki/bin/downloadrev/
Disallow /xwiki/bin/viewattachrev/
Disallow /xwiki/bin/export/
Disallow /xwiki/bin/undelete/
Disallow /xwiki/bin/get/
Disallow /xwiki/bin/view/Panels/
Disallow /xwiki/bin/view/Sandbox/
Disallow /xwiki/bin/view/ColorThemes/
Disallow /xwiki/bin/view/Invitation/
Disallow /xwiki/bin/view/Scheduler/
Disallow /xwiki/bin/view/WikiCode/
Disallow /xwiki/bin/view/WikiManager/
Disallow /xwiki/bin/view/WikiResources/
Disallow /xwiki/bin/view/XApp/
Disallow /xwiki/bin/view/XAppClasses/
Disallow /xwiki/bin/view/XAppCode/
Disallow /xwiki/bin/view/XAppManager/
Disallow /xwiki/bin/view/XAppSheets/
Disallow /xwiki/bin/view/XAppTemplates/
Disallow /xwiki/bin/view/XWiki/
Disallow /xwiki/bin/view/XemManager/
Disallow /xwiki/bin/view/XemResources/
Disallow /xwiki/bin/view/Blog/
Disallow /xwiki/bin/view/Admin/
Disallow /xwiki/bin/view/AnnotationCode/
Disallow /xwiki/bin/view/DisplayerCode/
Disallow /xwiki/bin/view/XAppResources/
Disallow /xwiki/bin/view/Stats/
Disallow /xwiki/bin/view/Dashboard/
Disallow /xwiki/bin/view/AppWithinMinutes/
Disallow /xwiki/bin/view/Main/AllDocs
Disallow /xwiki/bin/view/*/*?viewer=recyclebin

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /xmlrpc/
Disallow /pdf/
Disallow /edit/
Disallow /create/
Disallow /inline/
Disallow /preview/
Disallow /save/
Disallow /cancel/
Disallow /delete/
Disallow /register/
Disallow /propupdate/
Disallow /propadd/
Disallow /propdelete/
Disallow /commentadd/
Disallow /objectremove/
Disallow /attach/
Disallow /upload/
Disallow /download/
Disallow /dot/
Disallow /delattachment/
Disallow /login/
Disallow /loginerror/
Disallow /logout/
Disallow /status/
Disallow /lifeblog/
Disallow /viewrev/
Disallow /downloadrev/
Disallow /viewattachrev/
Disallow /export/
Disallow /undelete/
Disallow /get/
Disallow /Panels/
Disallow /Sandbox/
Disallow /ColorThemes/
Disallow /Invitation/
Disallow /Scheduler/
Disallow /WikiCode/
Disallow /WikiManager/
Disallow /WikiResources/
Disallow /XApp/
Disallow /XAppClasses/
Disallow /XAppCode/
Disallow /XAppManager/
Disallow /XAppSheets/
Disallow /XAppTemplates/
Disallow /XWiki/
Disallow /XemManager/
Disallow /XemResources/
Disallow /Blog/
Disallow /Admin/
Disallow /AnnotationCode/
Disallow /DisplayerCode/
Disallow /XAppResources/
Disallow /Stats/
Disallow /Dashboard/
Disallow /AppWithinMinutes/
Disallow /Main/AllDocs
Disallow /*/*?viewer=recyclebin

*

Rule Path
Disallow /fr/xmlrpc/
Disallow /fr/pdf/
Disallow /fr/edit/
Disallow /fr/create/
Disallow /fr/inline/
Disallow /fr/preview/
Disallow /fr/save/
Disallow /fr/cancel/
Disallow /fr/delete/
Disallow /fr/register/
Disallow /fr/propupdate/
Disallow /fr/propadd/
Disallow /fr/propdelete/
Disallow /fr/commentadd/
Disallow /fr/objectremove/
Disallow /fr/attach/
Disallow /fr/upload/
Disallow /fr/dot/
Disallow /fr/delattachment/
Disallow /fr/login/
Disallow /fr/loginerror/
Disallow /fr/logout/
Disallow /fr/status/
Disallow /fr/lifeblog/
Disallow /fr/viewrev/
Disallow /fr/downloadrev/
Disallow /fr/viewattachrev/
Disallow /fr/export/
Disallow /fr/undelete/
Disallow /fr/get/
Disallow /fr/Panels/
Disallow /fr/Sandbox/
Disallow /fr/ColorThemes/
Disallow /fr/Invitation/
Disallow /fr/Scheduler/
Disallow /fr/WikiCode/
Disallow /fr/WikiManager/
Disallow /fr/WikiResources/
Disallow /fr/XApp/
Disallow /fr/XAppClasses/
Disallow /fr/XAppCode/
Disallow /fr/XAppManager/
Disallow /fr/XAppSheets/
Disallow /fr/XAppTemplates/
Disallow /fr/XWiki/
Disallow /fr/XemManager/
Disallow /fr/XemResources/
Disallow /fr/Admin/
Disallow /fr/AnnotationCode/
Disallow /fr/DisplayerCode/
Disallow /fr/XAppResources/
Disallow /fr/Stats/
Disallow /fr/Dashboard/
Disallow /fr/AppWithinMinutes/
Disallow /fr/Main/AllDocs
Disallow /fr/*/*?viewer=recyclebin

*

Rule Path
Disallow /en/xmlrpc/
Disallow /en/pdf/
Disallow /en/edit/
Disallow /en/create/
Disallow /en/inline/
Disallow /en/preview/
Disallow /en/save/
Disallow /en/cancel/
Disallow /en/delete/
Disallow /en/register/
Disallow /en/propupdate/
Disallow /en/propadd/
Disallow /en/propdelete/
Disallow /en/commentadd/
Disallow /en/objectremove/
Disallow /en/attach/
Disallow /en/upload/
Disallow /en/dot/
Disallow /en/delattachment/
Disallow /en/login/
Disallow /en/loginerror/
Disallow /en/logout/
Disallow /en/status/
Disallow /en/lifeblog/
Disallow /en/viewrev/
Disallow /en/downloadrev/
Disallow /en/viewattachrev/
Disallow /en/export/
Disallow /en/undelete/
Disallow /en/get/
Disallow /en/Panels/
Disallow /en/Sandbox/
Disallow /en/ColorThemes/
Disallow /en/Invitation/
Disallow /en/Scheduler/
Disallow /en/WikiCode/
Disallow /en/WikiManager/
Disallow /en/WikiResources/
Disallow /en/XApp/
Disallow /en/XAppClasses/
Disallow /en/XAppCode/
Disallow /en/XAppManager/
Disallow /en/XAppSheets/
Disallow /en/XAppTemplates/
Disallow /en/XWiki/
Disallow /en/XemManager/
Disallow /en/XemResources/
Disallow /en/Admin/
Disallow /en/AnnotationCode/
Disallow /en/DisplayerCode/
Disallow /en/XAppResources/
Disallow /en/Stats/
Disallow /en/Dashboard/
Disallow /en/AppWithinMinutes/
Disallow /en/Main/AllDocs
Disallow /en/*/*?viewer=recyclebin

*

Rule Path
Disallow /en/Blog/AllBlogsPanel
Disallow /en/Blog/ApplicationsPanelEntry
Disallow /en/Blog/Archive
Disallow /en/Blog/ArchivePanel
Disallow /en/Blog/ArchiveSheet
Disallow /en/Blog/BlogClass
Disallow /en/Blog/BlogCode
Disallow /en/Blog/BlogIntroduction
Disallow /en/Blog/BlogMenuUIX
Disallow /en/Blog/BlogNotifications
Disallow /en/Blog/BlogParameters
Disallow /en/Blog/BlogPostClass
Disallow /en/Blog/BlogPostCreate
Disallow /en/Blog/BlogPostLayoutCards
Disallow /en/Blog/BlogPostLayoutCompact
Disallow /en/Blog/BlogPostLayoutFull
Disallow /en/Blog/BlogPostLayoutImage
Disallow /en/Blog/BlogPostLayoutLink
Disallow /en/Blog/BlogPostLayoutMacros
Disallow /en/Blog/BlogPostList
Disallow /en/Blog/BlogPostSheet
Disallow /en/Blog/BlogPostTemplate
Disallow /en/Blog/BlogPostTemplateProvider
Disallow /en/Blog/BlogPostsMigration
Disallow /en/Blog/BlogRss
Disallow /en/Blog/BlogScripts
Disallow /en/Blog/BlogSheet
Disallow /en/Blog/BlogStyle
Disallow /en/Blog/BlogTemplate
Disallow /en/Blog/BlogsLiveTable
Disallow /en/Blog/Categories
Disallow /en/Blog/CategoriesCode
Disallow /en/Blog/CategoriesPanel
Disallow /en/Blog/CategoriesSheet
Disallow /en/Blog/CategoryClass
Disallow /en/Blog/CategoryRss
Disallow /en/Blog/CategorySheet
Disallow /en/Blog/CategoryTemplate
Disallow /en/Blog/CreatePost
Disallow /en/Blog/EnablePanelsConfigurationClass
Disallow /en/Blog/EnablePanelsConfigurationService
Disallow /en/Blog/EnablePanelsConfigurationTemplate
Disallow /en/Blog/GlobalBlogRss
Disallow /en/Blog/ManageCategories
Disallow /en/Blog/Management
Disallow /en/Blog/Migration
Disallow /en/Blog/PinnedPostsClass
Disallow /en/Blog/PinnedPostsSheet
Disallow /en/Blog/PinnedPostsTemplate
Disallow /en/Blog/Publisher
Disallow /en/Blog/RecentPostsPanel
Disallow /en/Blog/RelatedBlogsPanel
Disallow /en/Blog/RssCode
Disallow /en/Blog/Unpublished
Disallow /en/Blog/UnpublishedPanel
Disallow /en/Blog/UnpublishedPostsSheet

*

Rule Path
Disallow /fr/Blog/AllBlogsPanel
Disallow /fr/Blog/ApplicationsPanelEntry
Disallow /fr/Blog/Archive
Disallow /fr/Blog/ArchivePanel
Disallow /fr/Blog/ArchiveSheet
Disallow /fr/Blog/BlogClass
Disallow /fr/Blog/BlogCode
Disallow /fr/Blog/BlogIntroduction
Disallow /fr/Blog/BlogMenuUIX
Disallow /fr/Blog/BlogNotifications
Disallow /fr/Blog/BlogParameters
Disallow /fr/Blog/BlogPostClass
Disallow /fr/Blog/BlogPostCreate
Disallow /fr/Blog/BlogPostLayoutCards
Disallow /fr/Blog/BlogPostLayoutCompact
Disallow /fr/Blog/BlogPostLayoutFull
Disallow /fr/Blog/BlogPostLayoutImage
Disallow /fr/Blog/BlogPostLayoutLink
Disallow /fr/Blog/BlogPostLayoutMacros
Disallow /fr/Blog/BlogPostList
Disallow /fr/Blog/BlogPostSheet
Disallow /fr/Blog/BlogPostTemplate
Disallow /fr/Blog/BlogPostTemplateProvider
Disallow /fr/Blog/BlogPostsMigration
Disallow /fr/Blog/BlogRss
Disallow /fr/Blog/BlogScripts
Disallow /fr/Blog/BlogSheet
Disallow /fr/Blog/BlogStyle
Disallow /fr/Blog/BlogTemplate
Disallow /fr/Blog/BlogsLiveTable
Disallow /fr/Blog/Categories
Disallow /fr/Blog/CategoriesCode
Disallow /fr/Blog/CategoriesPanel
Disallow /fr/Blog/CategoriesSheet
Disallow /fr/Blog/CategoryClass
Disallow /fr/Blog/CategoryRss
Disallow /fr/Blog/CategorySheet
Disallow /fr/Blog/CategoryTemplate
Disallow /fr/Blog/CreatePost
Disallow /fr/Blog/EnablePanelsConfigurationClass
Disallow /fr/Blog/EnablePanelsConfigurationService
Disallow /fr/Blog/EnablePanelsConfigurationTemplate
Disallow /fr/Blog/GlobalBlogRss
Disallow /fr/Blog/ManageCategories
Disallow /fr/Blog/Management
Disallow /fr/Blog/Migration
Disallow /fr/Blog/PinnedPostsClass
Disallow /fr/Blog/PinnedPostsSheet
Disallow /fr/Blog/PinnedPostsTemplate
Disallow /fr/Blog/Publisher
Disallow /fr/Blog/RecentPostsPanel
Disallow /fr/Blog/RelatedBlogsPanel
Disallow /fr/Blog/RssCode
Disallow /fr/Blog/Unpublished
Disallow /fr/Blog/UnpublishedPanel
Disallow /fr/Blog/UnpublishedPostsSheet

*

Rule Path
Disallow /fr/CompanyCode/
Disallow /fr/CookieConsent/
Disallow /fr/DisplayerCode/
Disallow /fr/EventsCode/
Disallow /fr/JobOffersCode/
Disallow /fr/Menu/
Disallow /fr/NewsletterCode/
Disallow /fr/PartnersCode/
Disallow /fr/ProductCode/
Disallow /fr/ReferencesCode/
Disallow /fr/ResearchProjectCode/
Disallow /fr/ServicesCode/
Disallow /fr/SilverbulletCode/
Disallow /fr/SolutionsCode/
Disallow /fr/TeamCode/
Disallow /fr/Totem/
Disallow /fr/TotemCode/
Disallow /fr/XWiki/
Disallow /fr/XWikiComCode/
Disallow /fr/PublicWebSite/Code/
Disallow /fr/PublicWebSite/
Disallow /fr/summit-2024/
Disallow /fr/summit-2024/party/

*

Rule Path
Disallow /en/CompanyCode/
Disallow /en/CookieConsent/
Disallow /en/DisplayerCode/
Disallow /en/EventsCode/
Disallow /en/JobOffersCode/
Disallow /en/Menu/
Disallow /en/NewsletterCode/
Disallow /en/PartnersCode/
Disallow /en/ProductCode/
Disallow /en/ReferencesCode/
Disallow /en/ResearchProjectCode/
Disallow /en/ServicesCode/
Disallow /en/SilverbulletCode/
Disallow /en/SolutionsCode/
Disallow /en/TeamCode/
Disallow /en/Totem/
Disallow /en/TotemCode/
Disallow /en/XWiki/
Disallow /en/XWikiComCode/
Disallow /en/PublicWebSite/Code/
Disallow /en/PublicWebSite/
Disallow /en/summit-2024/
Disallow /en/summit-2024/party/

*

Rule Path
Disallow /wiki/help/
Disallow /Help/
Disallow /help/

*

Rule Path
Disallow /bot-traffic.icu
Disallow /trafficbot.live

Comments

  • DEFAULT
  • With shorts urls
  • DEFAULT FR
  • DEFAULT EN
  • BLOG CODE EN
  • BLOG CODE FR
  • CUSTOM FR
  • CUSTOM EN
  • CUSTOM Help
  • Specific bots