ottawa.bibliocommons.com
robots.txt
Robots Exclusion Standard data for ottawa.bibliocommons.com
Resource Scan
Scan Details
| Site Domain | ottawa.bibliocommons.com |
| Base Domain | bibliocommons.com |
| Scan Status | Ok |
| Last Scan | 2024-06-08T21:50:42+00:00 |
| Next Scan | 2024-07-08T21:50:42+00:00 |
Last Scan
| Scanned | 2024-06-08T21:50:42+00:00 |
| URL | https://ottawa.bibliocommons.com/robots.txt |
| Domain IPs | 13.225.4.8, 13.225.4.89, 13.225.4.91, 13.225.4.98 |
| Response IP | 13.225.4.98 |
| Found | Yes |
| Hash | 57afdafb1346fe101ef29ff7d29bca89133fd0c468f45a0f5985f4117dc345d7 |
| SimHash | 2b5b4a570f65 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /layouts/ |
| Disallow | /holds/select_hold/ |
| Disallow | /item/report_match/ |
| Disallow | /info/select_library/ |
| Disallow | /monitor/ |
| Disallow | /item/digital_availability/ |
| Disallow | /item/show_circulation_widget/ |
| Disallow | /item/get_external_content/ |
| Disallow | /item/full_record/ |
| Disallow | /item/read_alike_list/ |
| Disallow | /item/load_ugc_content/ |
| Disallow | /item/syndetics_reviews |
| Disallow | /item/awards_and_series_list |
| Disallow | /item/bibs_from_isbns |
| Disallow | /item/show_circulation/ |
| Disallow | /collection/add/ |
| Disallow | /bib/match/ |
| Disallow | /list/new/my/ |
| Disallow | /dashboard/browse/shelf_browse |
| Disallow | /session/back_to |
| Disallow | /header/state |
| Disallow | /v2/availability/ |
| Allow | /* |
| Allow | /sitemap.xml |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ottawa.bibliocommons.com/sitemap |
Comments