canadafreepress.com
robots.txt
Robots Exclusion Standard data for canadafreepress.com
Resource Scan
Scan Details
Site Domain | canadafreepress.com |
Base Domain | canadafreepress.com |
Scan Status | Ok |
Last Scan | 2024-11-15T16:58:01+00:00 |
Next Scan | 2024-11-22T16:58:01+00:00 |
Last Scan
Scanned | 2024-11-15T16:58:01+00:00 |
URL | https://canadafreepress.com/robots.txt |
Domain IPs | 104.26.8.240, 104.26.9.240, 172.67.68.220, 2606:4700:20::681a:8f0, 2606:4700:20::681a:9f0, 2606:4700:20::ac43:44dc |
Response IP | 172.67.68.220 |
Found | Yes |
Hash | 33ef35b48c9a49d35833c928f9493d915509ce1d47c7934e31d0a4ee2fcb7c53 |
SimHash | 4b49d2c15590 |
Groups
*
Rule | Path |
---|---|
Allow |
*
Rule | Path |
---|---|
Disallow | /ads/ |
*
Rule | Path |
---|---|
Disallow | /resource/ |
Other Records
Field | Value |
---|---|
sitemap | https://canadafreepress.com/sitemaps/sitemap-index.xml |