Log In Sign Up

montreal.pretnumerique.ca
robots.txt

Robots Exclusion Standard data for montreal.pretnumerique.ca

Resource Scan

Scan Details

Site Domain montreal.pretnumerique.ca
Base Domain pretnumerique.ca
Scan Status Ok
Last Scan2025-06-01T23:27:09+00:00
Next Scan 2025-07-01T23:27:09+00:00

Last Scan

Scanned2025-06-01T23:27:09+00:00
URL https://montreal.pretnumerique.ca/robots.txt
Domain IPs 104.18.26.89, 104.18.27.89, 2606:4700::6812:1a59, 2606:4700::6812:1b59
Response IP 104.18.26.89
Found Yes
Hash 3a42b48e640402314bee9e9c81757ad9739896a0970ad2bb6e4000cc897b78b7
SimHash 3875d351c5d5

Groups

applebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Comments

  • Applebot is the web crawler for Apple.
  • https://www.apple.com/go/applebot
  • Bing search engine robot.
  • https://www.bing.com/bingbot.htm
  • Petal search engine Robot (HUAWEI).
  • https://aspiegel.com/petalbot
  • SEMrushBot is the search bot software used by SEMrush.
  • https://www.semrush.com/bot.html
  • Googlebot is the generic name for Google's web crawler.
  • https://support.google.com/webmasters/answer/182072
  • All other robots are disallowed from crawling our servers.
Back to top