Log In Sign Up

boite-outils.bib.umontreal.ca
robots.txt

Robots Exclusion Standard data for boite-outils.bib.umontreal.ca

Resource Scan

Scan Details

Site Domain boite-outils.bib.umontreal.ca
Base Domain umontreal.ca
Scan Status Ok
Last Scan2025-12-08T23:15:10+00:00
Next Scan 2026-01-07T23:15:10+00:00

Last Scan

Scanned2025-12-08T23:15:10+00:00
URL https://boite-outils.bib.umontreal.ca/robots.txt
Domain IPs 35.183.221.217, 52.60.177.45
Response IP 35.183.221.217
Found Yes
Hash 108274f1e97151c2db93d70a46bd62a4dda8c617785477c8e8cf73c43719e8b6
SimHash 1c2cc961c613

Groups

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

discobot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gemini-deep-research

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

tiktokspider

Rule Path
Disallow /

twitterbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 0

w3c-checklink

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

yandex

Rule Path
Disallow /

yandexadditional

Rule Path
Disallow /

yandexadditionalbot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://boite-outils.bib.umontreal.ca/sitemap.xml
Back to top