quebec.ca
robots.txt

Robots Exclusion Standard data for quebec.ca

Resource Scan

Scan Details

Site Domain quebec.ca
Base Domain quebec.ca
Scan Status Ok
Last Scan2024-05-30T07:28:29+00:00
Next Scan 2024-06-29T07:28:29+00:00

Last Scan

Scanned2024-05-30T07:28:29+00:00
URL https://quebec.ca/robots.txt
Redirect https://www.quebec.ca/robots.txt
Redirect Domain www.quebec.ca
Redirect Base quebec.ca
Domain IPs 3.163.125.110, 3.163.125.25, 3.163.125.51, 3.163.125.59
Redirect IPs 2600:9000:24db:1000:1f:60b1:5d40:93a1, 2600:9000:24db:1e00:1f:60b1:5d40:93a1, 2600:9000:24db:4600:1f:60b1:5d40:93a1, 2600:9000:24db:5400:1f:60b1:5d40:93a1, 2600:9000:24db:8600:1f:60b1:5d40:93a1, 2600:9000:24db:8a00:1f:60b1:5d40:93a1, 2600:9000:24db:b200:1f:60b1:5d40:93a1, 2600:9000:24db:c400:1f:60b1:5d40:93a1, 65.9.112.11, 65.9.112.24, 65.9.112.35, 65.9.112.78
Response IP 108.157.52.101
Found Yes
Hash 79044d9ee717600b8f5f880c5dde96501e4122b4d812958d08297587d7adfc0f
SimHash 2c813845cfc8

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?type=98*
Disallow /*%26type%3D98*
Disallow /*/Private/*
Disallow /*/Configuration/*
Disallow *.sql
Disallow *.sql.gz
Disallow /typo3temp/*
Allow /typo3temp/*.css
Allow /typo3temp/*.css.*.gzip
Allow /typo3temp/*.js
Allow /typo3temp/*.js.*.gzip
Allow /typo3temp/*.jpg
Allow /typo3temp/*.gif
Allow /typo3temp/*.png
Disallow /*cHash

Other Records

Field Value
sitemap https://www.quebec.ca/sitemap.xml

Comments

  • Only allow URLs generated with routing
  • L=0 is the default language
  • typeNum = 98 is usually the print version.
  • Should always be protected (.htaccess)
  • no cHash
  • sitemap