/.well-known/

Log In Sign Up

pretnumerique.ca
robots.txt

Robots Exclusion Standard data for pretnumerique.ca

Archived Snapshots

Resource Scan

Scan Details

Site Domain	pretnumerique.ca
Base Domain	pretnumerique.ca
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a client error.
Last Scan	2025-12-20T05:03:19+00:00
Next Scan	2026-02-18T05:03:19+00:00

Last Successful Scan

Scanned	2025-09-27T18:24:10+00:00
URL	https://pretnumerique.ca/robots.txt
Redirect	https://www.pretnumerique.ca/robots.txt
Redirect Domain	www.pretnumerique.ca
Redirect Base	pretnumerique.ca
Domain IPs	104.18.26.89, 104.18.27.89, 2606:4700::6812:1a59, 2606:4700::6812:1b59
Redirect IPs	104.18.26.89, 104.18.27.89, 2606:4700::6812:1a59, 2606:4700::6812:1b59
Response IP	104.18.27.89
Found	Yes
Hash	3a42b48e640402314bee9e9c81757ad9739896a0970ad2bb6e4000cc897b78b7
SimHash	3875d351c5d5

Groups

applebot

Rule

Path

Disallow

/

bingbot

Rule

Path

Disallow

/

petalbot

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

googlebot

Rule

Path

Allow

/

*

Rule

Path

Disallow

/

Back to top

Comments

Applebot is the web crawler for Apple.
https://www.apple.com/go/applebot
Bing search engine robot.
https://www.bing.com/bingbot.htm
Petal search engine Robot (HUAWEI).
https://aspiegel.com/petalbot
SEMrushBot is the search bot software used by SEMrush.
https://www.semrush.com/bot.html
Googlebot is the generic name for Google's web crawler.
https://support.google.com/webmasters/answer/182072
All other robots are disallowed from crawling our servers.

Back to top