canadafreepress.com
robots.txt

Robots Exclusion Standard data for canadafreepress.com

Resource Scan

Scan Details

Site Domain canadafreepress.com
Base Domain canadafreepress.com
Scan Status Ok
Last Scan2024-11-15T16:58:01+00:00
Next Scan 2024-11-22T16:58:01+00:00

Last Scan

Scanned2024-11-15T16:58:01+00:00
URL https://canadafreepress.com/robots.txt
Domain IPs 104.26.8.240, 104.26.9.240, 172.67.68.220, 2606:4700:20::681a:8f0, 2606:4700:20::681a:9f0, 2606:4700:20::ac43:44dc
Response IP 172.67.68.220
Found Yes
Hash 33ef35b48c9a49d35833c928f9493d915509ce1d47c7934e31d0a4ee2fcb7c53
SimHash 4b49d2c15590

Groups

googlebot

Rule Path
Allow

mediapartners-google

Rule Path
Allow

slurp

Rule Path
Allow

bingbot

Rule Path
Allow

duckduckbot

Rule Path
Allow

yandex

Rule Path
Allow

*

Rule Path
Allow

mega-index

Rule Path
Disallow

alexabot

Rule Path
Disallow /

*

Rule Path
Disallow /ads/

*

Rule Path
Disallow /resource/

Other Records

Field Value
sitemap https://canadafreepress.com/sitemaps/sitemap-index.xml