xwiki.org
robots.txt

Robots Exclusion Standard data for xwiki.org

Resource Scan

Scan Details

Site Domain xwiki.org
Base Domain xwiki.org
Scan Status Ok
Last Scan2024-05-23T04:49:47+00:00
Next Scan 2024-06-22T04:49:47+00:00

Last Scan

Scanned2024-05-23T04:49:47+00:00
URL https://xwiki.org/robots.txt
Redirect https://www.xwiki.org/robots.txt
Redirect Domain www.xwiki.org
Redirect Base xwiki.org
Domain IPs 104.26.8.174, 104.26.9.174, 172.67.71.120, 2606:4700:20::681a:8ae, 2606:4700:20::681a:9ae, 2606:4700:20::ac43:4778
Redirect IPs 104.26.8.174, 104.26.9.174, 172.67.71.120, 2606:4700:20::681a:8ae, 2606:4700:20::681a:9ae, 2606:4700:20::ac43:4778
Response IP 104.26.9.174
Found Yes
Hash 04f68ec71519b14be2ec2b3cf178aa0d13196a51ccfbc70977dcb86548de027f
SimHash 8907306cbd26

Groups

*

Rule Path
Disallow /xwiki/bin/viewattachrev/
Disallow /xwiki/bin/viewrev/
Disallow /xwiki/bin/pdf/
Disallow /xwiki/bin/tex/
Disallow /xwiki/bin/edit/
Disallow /xwiki/bin/create/
Disallow /xwiki/bin/inline/
Disallow /xwiki/bin/preview/
Disallow /xwiki/bin/save/
Disallow /xwiki/bin/saveandcontinue/
Disallow /xwiki/bin/rollback/
Disallow /xwiki/bin/deleteversions/
Disallow /xwiki/bin/cancel/
Disallow /xwiki/bin/delete/
Disallow /xwiki/bin/deletespace/
Disallow /xwiki/bin/undelete/
Disallow /xwiki/bin/reset/
Disallow /xwiki/bin/register/
Disallow /xwiki/bin/propupdate/
Disallow /xwiki/bin/propadd/
Disallow /xwiki/bin/propdisable/
Disallow /xwiki/bin/propenable/
Disallow /xwiki/bin/propdelete/
Disallow /xwiki/bin/objectadd/
Disallow /xwiki/bin/commentadd/
Disallow /xwiki/bin/commentsave/
Disallow /xwiki/bin/objectsync/
Disallow /xwiki/bin/objectremove/
Disallow /xwiki/bin/attach/
Disallow /xwiki/bin/upload/
Disallow /xwiki/bin/download/
Disallow /xwiki/bin/temp/
Disallow /xwiki/bin/downloadrev/
Disallow /xwiki/bin/dot/
Disallow /xwiki/bin/svg/
Disallow /xwiki/bin/delattachment/
Disallow /xwiki/bin/skin/
Disallow /xwiki/bin/jsx/
Disallow /xwiki/bin/ssx/
Disallow /xwiki/bin/login/
Disallow /xwiki/bin/loginsubmit/
Disallow /xwiki/bin/loginerror/
Disallow /xwiki/bin/logout/
Disallow /xwiki/bin/charting/
Disallow /xwiki/bin/lock/
Disallow /xwiki/bin/redirect/
Disallow /xwiki/bin/admin/
Disallow /xwiki/bin/export/
Disallow /xwiki/bin/import/
Disallow /xwiki/bin/get/
Disallow /xwiki/bin/distribution/
Disallow /xwiki/bin/imagecaptcha/
Disallow /xwiki/bin/unknown/
Disallow /xwiki/bin/webjars/
Disallow /xwiki/bin/view/Sandbox/
Disallow /xwiki/bin/view/Admin/
Disallow /xwiki/bin/view/Stats/
Disallow /xwiki/bin/view/Panels/
Disallow /*?*xpage=*

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10