scoutmagazine.ca
robots.txt

Robots Exclusion Standard data for scoutmagazine.ca

Resource Scan

Scan Details

Site Domain scoutmagazine.ca
Base Domain scoutmagazine.ca
Scan Status Ok
Last Scan2025-03-20T14:20:50+00:00
Next Scan 2025-04-19T14:20:50+00:00

Last Scan

Scanned2025-03-20T14:20:50+00:00
URL https://scoutmagazine.ca/robots.txt
Domain IPs 104.21.56.197, 172.67.187.216, 2606:4700:3032::ac43:bbd8, 2606:4700:3035::6815:38c5
Response IP 104.21.56.197
Found Yes
Hash 2b050b1d1146fabed351588874d195e2f961670bb062d9328206db5f1951b0e4
SimHash 9655c4907690

Groups

*

Rule Path
Disallow /menu
Disallow /search
Disallow /xhr-opening-soon
Disallow /l.php
Disallow /v.php
Disallow /tag/

bingbot

Rule Path
Disallow *?s=*

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

Comments

  • Search URLs
  • BOTS