bibsonomy.org
robots.txt

Robots Exclusion Standard data for bibsonomy.org

Resource Scan

Scan Details

Site Domain bibsonomy.org
Base Domain bibsonomy.org
Scan Status Ok
Last Scan2024-09-28T07:46:58+00:00
Next Scan 2024-10-28T07:46:58+00:00

Last Scan

Scanned2024-09-28T07:46:58+00:00
URL https://bibsonomy.org/robots.txt
Redirect https://www.bibsonomy.org/robots.txt
Redirect Domain www.bibsonomy.org
Redirect Base bibsonomy.org
Domain IPs 132.187.15.88
Redirect IPs 132.187.15.88
Response IP 132.187.15.88
Found Yes
Hash c4564cdef9ce585796320c1af56793f7173cdc83789c4e5880e5ddebcb636cf3
SimHash f905c76aeaeb

Groups

*

Rule Path
Disallow /layout/
Disallow /csl-layout/
Disallow /endnote/
Disallow /bib/
Disallow /publ/
Disallow /concept/
Disallow /search/
Disallow /documents/
Disallow /bookbib/
Disallow /xml/
Disallow /swrc/
Disallow /publrss/
Disallow /burst/
Disallow /memento/
Disallow /history/
Disallow /deletePost
Disallow /editBookmark
Disallow /editPublication
Disallow /ShowBookmarkEntry
Disallow /BibtexHandler
Disallow /api
Disallow /ajax/
Disallow /help_en/Login.jsp
Disallow /help_ru/Login.jsp
Disallow /help_de/Login.jsp
Disallow /help_en/Edit.jsp
Disallow /help_de/Edit.jsp
Disallow /help_ru/Edit.jsp

vegi bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5