montrealdaily.ca
robots.txt

Robots Exclusion Standard data for montrealdaily.ca

Resource Scan

Scan Details

Site Domain montrealdaily.ca
Base Domain montrealdaily.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-31T06:56:33+00:00
Next Scan 2024-08-29T06:56:33+00:00

Last Successful Scan

Scanned2023-02-06T16:55:25+00:00
URL https://montrealdaily.ca/robots.txt
Domain IPs 104.21.41.236, 172.67.196.185, 2606:4700:3037::6815:29ec, 2606:4700:3037::ac43:c4b9
Response IP 104.21.41.236
Found Yes
Hash c832ccb3858c4c49895f6a0638e3b12575aa3e888ce39de846cad0312e192c47
SimHash 4b44cac00212

Groups

*

Rule Path
Disallow
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

mozilla/5.0 (compatible; taboolabot/3.7; +http://www.taboola.com)

Rule Path
Allow /

taboolabot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /wp-content/plugins/