guides.ucclibrary.com
robots.txt

Robots Exclusion Standard data for guides.ucclibrary.com

Resource Scan

Scan Details

Site Domain guides.ucclibrary.com
Base Domain ucclibrary.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-08-15T23:44:28+00:00
Next Scan 2024-11-13T23:44:28+00:00

Last Successful Scan

Scanned2023-09-28T02:48:09+00:00
URL https://guides.ucclibrary.com/robots.txt
Redirect https://library.umpqua.edu/robots.php
Redirect Domain library.umpqua.edu
Redirect Base umpqua.edu
Domain IPs 3.86.37.148, 34.194.39.199, 54.85.246.96, 54.88.35.99
Redirect IPs 3.86.37.148, 34.194.39.199, 54.85.246.96, 54.88.35.99
Response IP 54.85.246.96
Found Yes
Hash 897e7a736c193b2b207c02efa587dfbd6234736a39d71275925f94d62ef4c32d
SimHash 08a0ac828683

Groups

discobot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

w3c-checklink

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

twitterbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 0

*

Rule Path
Disallow /er.php
Disallow /err.php
Disallow /go.php
Disallow /friendly.php
Disallow /ld.php
Disallow /srch.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://library.umpqua.edu/sitemap.xml