gnb.ca
robots.txt

Robots Exclusion Standard data for gnb.ca

Resource Scan

Scan Details

Site Domain gnb.ca
Base Domain gnb.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-08T22:04:42+00:00
Next Scan 2025-01-06T22:04:42+00:00

Last Successful Scan

Scanned2023-08-18T16:17:24+00:00
URL https://gnb.ca/robots.txt
Domain IPs 142.139.25.42
Response IP 142.139.25.42
Found Yes
Hash 7af6b47aff1cfe77aa084136cb61b19428d1242a8a39fd276ccb2260e4ba3cf4
SimHash 260e39ca57d2

Groups

*

Rule Path Comment
Disallow /scripts/ Do not allow this folder to be searched
Disallow /Scripts/ Do not allow this folder to be searched
Disallow /scripts2/ Do not allow this folder to be searched
Disallow /Scripts2/ Do not allow this folder to be searched
Disallow /include/ Do not allow this folder to be searched
Disallow /nosearch/ Do not allow this folder to be searched
Disallow /metaadditions-english.txt Do not allow this file to be indexed
Disallow /metaadditions-french.txt Do not allow this file to be indexed
Disallow /0062/ Do not allow this directory to be indexed
Disallow /0396/ Do not allow this folder to be searched
Disallow /5107/ Do not allow this folder to be searched
Disallow /cour/03COA1/ Do not allow this directory to be indexed
Disallow /cour/04CQB/ Do not allow this directory to be indexed
Disallow /cour/05Prob/ Do not allow this directory to be indexed
Disallow /cour/06PCNB/ Do not allow this directory to be indexed
Disallow /cour/Templates/ Do not allow this directory to be indexed
Disallow /legis/ Do not allow this directory to be indexed
Disallow /cnb/CNBNews/ Do not allow this file to be indexed
Disallow /cnb/cnbnews/ Do not allow this file to be indexed
Disallow /cnb/Promos/ Do not allow this file to be indexed
Disallow /cnb/promos/ Do not allow this file to be indexed
Disallow /cnb/TeleVox/ Do not allow this directory to be indexed
Disallow /cnb/news/ Do not allow this directory to be indexed
Disallow /cnb/newsf/ Do not allow this directory to be indexed
Disallow /cnb/images/ Do not allow this directory to be indexed
Disallow /cnb/ImageBank3/ Do not allow this directory to be indexed
Disallow /redirect/ Do not allow this directory to be indexed
Disallow /0113/en/ Do not allow this directory to be indexed
Disallow /0113/fr/ Do not allow this directory to be indexed

Comments

  • robots.txt for http://www.gnb.ca/