mods.mb.ca
robots.txt

Robots Exclusion Standard data for mods.mb.ca

Resource Scan

Scan Details

Site Domain mods.mb.ca
Base Domain mods.mb.ca
Scan Status Ok
Last Scan2025-12-05T20:51:50+00:00
Next Scan 2026-01-04T20:51:50+00:00

Last Scan

Scanned2025-12-05T20:51:50+00:00
URL https://mods.mb.ca/robots.txt
Domain IPs 104.21.24.199, 172.67.220.77, 2606:4700:3034::ac43:dc4d, 2606:4700:3035::6815:18c7
Response IP 104.21.24.199
Found Yes
Hash ce4e5965641f629a9e8753171f00fcddfad18abba1c2b6da04ccf6df0474f0ad
SimHash 51148c10cb91

Groups

*

Rule Path
Disallow /admin/
Allow /admin/*.css
Allow /admin/*.js
Allow /admin/*.png
Allow /admin/*.jpg
Allow /admin/*.svg
Allow /admin/*/themes/

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

elutabot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /