canoe.ca
robots.txt

Robots Exclusion Standard data for canoe.ca

Resource Scan

Scan Details

Site Domain canoe.ca
Base Domain canoe.ca
Scan Status Ok
Last Scan2024-04-29T19:10:57+00:00
Next Scan 2024-05-29T19:10:57+00:00

Last Scan

Scanned2024-04-29T19:10:57+00:00
URL https://canoe.ca/robots.txt
Redirect https://www.canoe.ca/robots.txt
Redirect Domain www.canoe.ca
Redirect Base canoe.ca
Domain IPs 104.21.41.139, 172.67.191.51, 2606:4700:3030::ac43:bf33, 2606:4700:3034::6815:298b
Redirect IPs 104.21.41.139, 172.67.191.51, 2606:4700:3030::ac43:bf33, 2606:4700:3034::6815:298b
Response IP 172.67.191.51
Found Yes
Hash dec0858b71259b97ee769f8f32d73d3ef94d5e7fbb3a36b21a853a55dc405712
SimHash 004c98b0cd92

Groups

semrushbot

Rule Path
Disallow /

httpfetcher

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /*/security/search-results.aspx?
Disallow /irir/*
Allow /wp-admin/admin-ajax.php