Log In Sign Up

peelregion.ca
robots.txt

Robots Exclusion Standard data for peelregion.ca

Resource Scan

Scan Details

Site Domain peelregion.ca
Base Domain peelregion.ca
Scan Status Ok
Last Scan2024-09-18T02:20:04+00:00
Next Scan 2024-10-18T02:20:04+00:00

Last Scan

Scanned2024-09-18T02:20:04+00:00
URL https://peelregion.ca/robots.txt
Domain IPs 18.155.68.12, 18.155.68.13, 18.155.68.48, 18.155.68.97
Response IP 18.155.68.13
Found Yes
Hash d9f84b1c85e62c0bc12dc914408452c17291c937bf195388496920bcfb155c71
SimHash ab12c7434711

Groups

googlebot-image

Rule Path
Allow /waste/
Disallow /

*

Rule Path
Disallow /_demosiste/
Disallow /waste2/
Disallow /twaste3/
Disallow /twaste11/
Disallow /*.ssi$
Disallow /includes
Disallow /include
Disallow /health/prof/
Disallow /ttranshelp/
Back to top

Other Records

Field Value
sitemap http://peelregion.ca/sitemap_index.xml
Back to top

Comments

  • Now allowing google to index images in WEM
  • Allow is a non-standard extension without universal support; supported by yahoo, google and microsoft bing
  • These are staging areas and server side include file type
  • Sitemap being worked on right now
Back to top