voyage.caaquebec.com
robots.txt

Robots Exclusion Standard data for voyage.caaquebec.com

Resource Scan

Scan Details

Site Domain voyage.caaquebec.com
Base Domain caaquebec.com
Scan Status Ok
Last Scan2024-11-03T13:39:27+00:00
Next Scan 2024-12-03T13:39:27+00:00

Last Scan

Scanned2024-11-03T13:39:27+00:00
URL https://voyage.caaquebec.com/robots.txt
Domain IPs 13.227.254.26, 13.227.254.33, 13.227.254.60, 13.227.254.81
Response IP 13.227.254.81
Found Yes
Hash e5b40a3e6b364c60ebe57d59481e1fba808d49257d363a5e1d3b3598447e0c46
SimHash 4801d140c5e5

Groups

mediapartners-google*

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

googlemediabot*

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

googlebot

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

gulliver

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

slurp

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

fast

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

scooter

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

vscooter

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

ia_archiver

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

nutch

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

fast-webcrawler

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

teoma

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

lycos_spider_(t-rex)

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

bingbot

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

msnbot

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

msnptc

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

msnbot-media/1.0

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

architextspider

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

zyborg

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

surveybot

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

alexabot

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

baiduspider

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

yandex

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

jikespider

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs

rogerbot

Rule Path
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3conf/
Disallow /typo3_src/

elastic-crawler (8.12.2)

Rule Path
Disallow /fr/votre-dossier
Disallow /en/your-account
Disallow /fileadmin/documents/exclusifs
Disallow /fr/storage
Disallow /en/storage

elastic-crawler (8.12.2)

Rule Path
Disallow /fr/espace-connecte
Disallow /en/connected-space

elastic-crawler (8.15.1)

Rule Path
Disallow /fr/espace-connecte
Disallow /en/connected-space

facebookexternalhit

Rule Path
Disallow

facebookcatalog

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • Disallow all other crawlers