revenuquebec.ca
robots.txt

Robots Exclusion Standard data for revenuquebec.ca

Resource Scan

Scan Details

Site Domain revenuquebec.ca
Base Domain revenuquebec.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-10T08:01:15+00:00
Next Scan 2024-08-08T08:01:15+00:00

Last Successful Scan

Scanned2023-09-21T07:41:11+00:00
URL https://revenuquebec.ca/robots.txt
Redirect https://www.revenuquebec.ca:443/robots.txt
Redirect Domain www.revenuquebec.ca
Redirect Base revenuquebec.ca
Domain IPs 35.71.182.16, 52.223.15.70
Redirect IPs 13.224.249.28, 13.224.249.55, 13.224.249.77, 13.224.249.97, 2600:9000:21b4:2400:12:899c:540:93a1, 2600:9000:21b4:3a00:12:899c:540:93a1, 2600:9000:21b4:6000:12:899c:540:93a1, 2600:9000:21b4:9c00:12:899c:540:93a1, 2600:9000:21b4:b000:12:899c:540:93a1, 2600:9000:21b4:ba00:12:899c:540:93a1, 2600:9000:21b4:c00:12:899c:540:93a1, 2600:9000:21b4:cc00:12:899c:540:93a1
Response IP 13.224.249.28
Found Yes
Hash cc58a7700eaed9d72addbc58709015525a2ead4e083dbcd4253c13ec29d4ec65
SimHash 650843458ba0

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*.html
Disallow /*/Private/*
Disallow /*/Configuration/*
Disallow /mazoneextranet/*
Disallow /documents/*
Allow /documents/*.pdf
Allow /documents/*/*.pdf
Allow /images/*
Disallow /typo3temp/*
Allow /typo3temp/*.css
Allow /typo3temp/*.css.*.gzip
Allow /typo3temp/*.js
Allow /typo3temp/*.js.*.gzip
Allow /typo3temp/*.jpg
Allow /typo3temp/*.gif
Allow /typo3temp/*.png

Other Records

Field Value
sitemap https://www.revenuquebec.ca/fr/sitemap.xml
sitemap https://www.revenuquebec.ca/en/sitemap.xml

Comments

  • Revenu Québec
  • NE PAS INDEXER les url avec les param id et L
  • NE PAS INDEXER les url que se termine par .html
  • NE PAS INDEXER les répertoires /Private/ et /Configuration/ (toujours être protégé avec .htaccess)
  • NE PAS INDEXER La page Ma Zone Extranet
  • INDEXER seulement les .pdf dans le répertoire /documents/
  • INDEXER toutes les images
  • INDEXER seulement les .css, .js, .jpg, .gif et .png dans le répertoire /typo3temp/
  • Liste des sitemap.xml