mathers.ca
robots.txt

Robots Exclusion Standard data for mathers.ca

Resource Scan

Scan Details

Site Domain mathers.ca
Base Domain mathers.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-16T21:41:53+00:00
Next Scan 2026-02-14T21:41:53+00:00

Last Successful Scan

Scanned2024-07-02T10:11:54+00:00
URL https://mathers.ca/robots.txt
Domain IPs 104.21.77.211, 172.67.211.197, 2606:4700:3030::ac43:d3c5, 2606:4700:3035::6815:4dd3
Response IP 172.67.211.197
Found Yes
Hash 661564aaf2784380b4276fa555bd2cedd9535df19c1a1e44ec3303b2e1d4f26b
SimHash 65803f044723

Groups

*

Rule Path
Disallow /wp/wp-admin/
Disallow /wp/wp-login.php
Disallow /cgi-bin
Disallow /*?
Disallow */trackback
Disallow /*/comments
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Disallow /wp/wp-includes
Disallow /wp/wp-content/plugins
Disallow /wp/wp-content/cache
Disallow /wp/wp-content/themes
Disallow /app/wp-includes
Disallow /app/wp-content/plugins
Disallow /app/wp-content/cache
Disallow /app/wp-content/themes
Disallow */feed
Disallow */rss2
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://mathers.ca/sitemap_index.xml