Log In Sign Up

canada.gc.ca
robots.txt

Robots Exclusion Standard data for canada.gc.ca

Resource Scan

Scan Details

Site Domain canada.gc.ca
Base Domain canada.gc.ca
Scan Status Ok
Last Scan2024-06-04T22:36:48+00:00
Next Scan 2024-07-04T22:36:48+00:00

Last Scan

Scanned2024-06-04T22:36:48+00:00
URL https://canada.gc.ca/robots.txt
Redirect https://www.canada.ca/robots.txt
Redirect Domain www.canada.ca
Redirect Base canada.ca
Domain IPs 205.193.117.94, 205.193.215.2
Redirect IPs 23.39.12.219, 2600:1413:b000:690::fe9, 2600:1413:b000:691::fe9
Response IP 23.39.12.219
Found Yes
Hash 75c2cdc7e217f706a733f0192c2910fa0e359ade0ddb8d93e2df0ad00a051a68
SimHash b052bec86355

Groups

*

Rule Path
Disallow /content/dam/cra-arc/formspubs/
Disallow /en/revenue-agency/web-services-test/
Disallow /fr/agence-revenu/test-web-services/
Disallow /en/sr/srb.html
Disallow /fr/sr/srb.html
Disallow /en/sr/srb/sra.html
Disallow /fr/sr/srb/sra.html
Disallow /en/*/search.html
Disallow /en/*/search/advanced-search.html
Disallow /fr/*/rechercher.html
Disallow /fr/*/rechercher/recherche-avancee.html
Disallow /en/*/menu/header.html
Disallow /fr/*/menu/header.html
Disallow /en/*/menu/footer.html
Disallow /fr/*/menu/footer.html
Disallow /en/*/menu.html
Disallow /fr/*/menu.html
Disallow /en/*/footer/contactinformation.html
Disallow /fr/*/footer/Coordonnees.html
Disallow /*/_jcr_content/par*
Disallow /en/service-canada/
Disallow /fr/service-canada/
Disallow /en/immigration-refugees-citizenship/services/reference-include/
Disallow /fr/immigration-refugies-citoyennete/services/reference-inclusion/
Disallow /content/dam/ircc/documents/pdf/english/kits/guides/guide-0142-airlifted-afghanistan-pathway-pr.pdf
Disallow /content/dam/ircc/documents/pdf/francais/trousses/guides/guide-0142-avion-afghanistan-voie-acces-rp.pdf
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm0143e.pdf
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm0143f.pdf
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm0144e.pdf
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm0144f.pdf
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm5444/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm5444/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm5644/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm5644/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm5475/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm5475/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/imm5476/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/imm5476/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/irm0002/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/irm0002/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/irm0004/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/irm0004/
Disallow /content/dam/ircc/documents/pdf/english/kits/forms/irm0005/
Disallow /content/dam/ircc/documents/pdf/francais/trousses/form/irm0005/
Back to top

Comments

  • Government of Canada / Gouvernement du Canada
  • Block AEM folders for CRA
  • Search pages do not need to be crawled
  • IRCC PDFs
Back to top