www.e-codices.unifr.ch
robots.txt
Robots Exclusion Standard data for www.e-codices.unifr.ch
Resource Scan
Scan Details
| Site Domain | www.e-codices.unifr.ch |
| Base Domain | unifr.ch |
| Scan Status | Ok |
| Last Scan | 2025-03-04T06:35:22+00:00 |
| Next Scan | 2025-04-03T06:35:22+00:00 |
Last Scan
| Scanned | 2025-03-04T06:35:22+00:00 |
| URL | https://www.e-codices.unifr.ch/robots.txt |
| Domain IPs | 134.21.85.113 |
| Response IP | 134.21.85.113 |
| Found | Yes |
| Hash | 76bbf0bd4049b928c34ff2b08f8e92b4654ab60814c81ce3dee4b5ca4b9951c4 |
| SimHash | 1a4a44d0e2f0 |
Groups
ahrefsbot
gigabot
piplbot
semrushbot
semrushbot-sa
seokicks
seoscanners.net
turnitinbot
| Rule | Path |
|---|---|
| Disallow | / |
ccbot
linguee
tigerbot
| Rule | Path |
|---|---|
| Disallow | /xml/tei_staged/ |
| Disallow | README |
| Disallow | /*/rotate/facsimile/* |
| Disallow | /*/rotate/binding/* |
| Disallow | /*/change_size/binding/* |
| Disallow | /*/change_size/facsimile/* |
| Disallow | /*/change_page/facsimile/* |
| Disallow | /*/change_page/binding/* |
| Disallow | /*/preview/ |
| Disallow | /*/send/* |
| Disallow | /*/download/* |
| Disallow | /*/list/all/title/* |
| Disallow | /mobile/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
ia_archiver
yandex
| Rule | Path |
|---|---|
| Disallow | /xml/tei_staged/ |
| Disallow | README |
| Disallow | /*/rotate/facsimile/* |
| Disallow | /*/rotate/binding/* |
| Disallow | /*/change_size/binding/* |
| Disallow | /*/change_size/facsimile/* |
| Disallow | /*/change_page/facsimile/* |
| Disallow | /*/change_page/binding/* |
| Disallow | /*/preview/ |
| Disallow | /*/send/* |
| Disallow | /*/download/* |
| Disallow | /*/list/all/title/* |
| Disallow | /mobile/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /xml/tei_staged/ |
| Disallow | README |
| Disallow | /*/rotate/facsimile/* |
| Disallow | /*/rotate/binding/* |
| Disallow | /*/change_size/binding/* |
| Disallow | /*/change_size/facsimile/* |
| Disallow | /*/change_page/facsimile/* |
| Disallow | /*/change_page/binding/* |
| Disallow | /*/preview/ |
| Disallow | /*/send/* |
| Disallow | /*/download/* |
| Disallow | /*/list/all/title/* |
| Disallow | /mobile/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Comments