bibliotheques.univ-rennes.fr
robots.txt

Robots Exclusion Standard data for bibliotheques.univ-rennes.fr

Resource Scan

Scan Details

Site Domain bibliotheques.univ-rennes.fr
Base Domain univ-rennes.fr
Scan Status Ok
Last Scan2025-07-02T09:05:39+00:00
Next Scan 2025-08-01T09:05:39+00:00

Last Scan

Scanned2025-07-02T09:05:39+00:00
URL https://bibliotheques.univ-rennes.fr/robots.txt
Domain IPs 129.20.126.139
Response IP 129.20.126.139
Found Yes
Hash cb863051acf8310e6c988ddfd8aaa21580f33328ac823bab784d936ffc0ed0f8
SimHash 2d96818647c0

Groups

googlebot

Rule Path
Allow /interlocuteurs/*
Allow /index.php/interlocuteurs/*
Allow /fr/interlocuteurs/*
Allow /index.php/fr/interlocuteurs/*
Allow /interlocutors/*
Allow /index.php/interlocutors/*
Allow /en/interlocutors/*
Allow /index.php/en/interlocutors/*

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
amazonbot
applebot
applenewsbot
barkrowler
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebot
feedly
findxbot
gooblog
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
mj12bot
orangebot
perplexitybot
pinterest
qwantify
slurp
teoma
twitterbot
wotbox
yoozbot
youdaobot

Rule Path
Allow /themes/*/favicon.ico
Disallow /core/
Disallow /libraries/
Disallow /modules/
Disallow /profiles/
Disallow /themes/
Disallow /vendor/
Disallow /.csslintrc
Disallow /.eslintignore
Disallow /.eslintrc.json
Disallow /INSTALL.txt
Disallow /README.md
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /user/logout
Disallow /media/oembed
Disallow /*/media/oembed
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password
Disallow /index.php/user/register
Disallow /index.php/user/login
Disallow /index.php/user/logout
Disallow /index.php/media/oembed
Disallow /index.php/*/media/oembed
Disallow /fr/user/register
Disallow /fr/user/password
Disallow /fr/user/login
Disallow /fr/user/logout
Disallow /en/user/register
Disallow /en/user/password
Disallow /en/user/login
Disallow /en/user/logout
Disallow /index.php/fr/user/password
Disallow /index.php/fr/user/register
Disallow /index.php/fr/user/login
Disallow /index.php/fr/user/logout
Disallow /index.php/en/user/password
Disallow /index.php/en/user/register
Disallow /index.php/en/user/login
Disallow /index.php/en/user/logout
Disallow /interlocuteurs?*
Disallow /interlocuteurs
Disallow /fr/interlocuteurs?*
Disallow /fr/interlocuteurs
Disallow /index.php/interlocuteurs?*
Disallow /index.php/interlocuteurs
Disallow /index.php/fr/interlocuteurs?*
Disallow /index.php/fr/interlocuteurs
Disallow /interlocutors?*
Disallow /interlocutors
Disallow /en/interlocutors?*
Disallow /en/interlocutors
Disallow /index.php/interlocutors?*
Disallow /index.php/interlocutors
Disallow /index.php/en/interlocutors?*
Disallow /index.php/en/interlocutors
Disallow /ressources?*
Disallow /ressources
Disallow /fr/ressources?*
Disallow /fr/ressources
Disallow /index.php/ressources?*
Disallow /index.php/ressources
Disallow /index.php/fr/ressources?*
Disallow /index.php/fr/ressources
Disallow /resources?*
Disallow /resources
Disallow /en/resources?*
Disallow /en/resources
Disallow /index.php/resources?*
Disallow /index.php/resources
Disallow /index.php/en/resources?*
Disallow /index.php/en/resources
Disallow /seminars?*
Disallow /seminars
Disallow /en/seminars?*
Disallow /en/seminars
Disallow /index.php/seminars?*
Disallow /index.php/seminars
Disallow /index.php/en/seminars?*
Disallow /index.php/en/seminars
Disallow /seminars-old?*
Disallow /seminars-old
Disallow /en/seminars-old?*
Disallow /en/seminars-old
Disallow /index.php/seminars-old?*
Disallow /index.php/seminars-old
Disallow /index.php/en/seminars-old?*
Disallow /index.php/en/seminars-old
Disallow /*?
Disallow /*?f%5B*
Disallow /*%26f%5B*
Disallow /*?f%255B*
Disallow

*

Rule Path
Disallow /awwwards

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20