Log In Sign Up

m-x.ca
robots.txt

Robots Exclusion Standard data for m-x.ca

Resource Scan

Scan Details

Site Domain m-x.ca
Base Domain m-x.ca
Scan Status Ok
Last Scan2025-12-16T11:12:36+00:00
Next Scan 2026-01-15T11:12:36+00:00

Last Scan

Scanned2025-12-16T11:12:36+00:00
URL https://m-x.ca/robots.txt
Redirect https://www.m-x.ca/robots.txt
Redirect Domain www.m-x.ca
Redirect Base m-x.ca
Domain IPs 2600:9000:25ea:2600:c:56f3:9440:93a1, 2600:9000:25ea:3200:c:56f3:9440:93a1, 2600:9000:25ea:4a00:c:56f3:9440:93a1, 2600:9000:25ea:4c00:c:56f3:9440:93a1, 2600:9000:25ea:5000:c:56f3:9440:93a1, 2600:9000:25ea:600:c:56f3:9440:93a1, 2600:9000:25ea:7a00:c:56f3:9440:93a1, 2600:9000:25ea:d800:c:56f3:9440:93a1, 3.175.86.109, 3.175.86.117, 3.175.86.15, 3.175.86.5
Redirect IPs 108.157.194.19, 108.157.194.72, 108.157.194.80, 108.157.194.97, 2600:9000:25ea:200:c:56f3:9440:93a1, 2600:9000:25ea:3400:c:56f3:9440:93a1, 2600:9000:25ea:5000:c:56f3:9440:93a1, 2600:9000:25ea:5e00:c:56f3:9440:93a1, 2600:9000:25ea:a000:c:56f3:9440:93a1, 2600:9000:25ea:c00:c:56f3:9440:93a1, 2600:9000:25ea:c200:c:56f3:9440:93a1, 2600:9000:25ea:e800:c:56f3:9440:93a1
Response IP 3.169.71.18
Found Yes
Hash 0c4017ec4a05cc9ed18b31547522b54436b22d4becbe3d6535031d0efeea8a3f
SimHash 6c6d5951f5c6

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

*

Rule Path
Disallow /en/resource/
Disallow /fr/resource/
Disallow /private/
Disallow /tmp/

Other Records

Field Value
crawl-delay 15
Back to top

Other Records

Field Value
sitemap https://www.m-x.ca/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.m-x.ca/
  • Disallow crawling of internal resource directories
  • Sitemap location
Back to top