mitt.ca
robots.txt

Robots Exclusion Standard data for mitt.ca

Resource Scan

Scan Details

Site Domain mitt.ca
Base Domain mitt.ca
Scan Status Ok
Last Scan2025-10-09T15:10:56+00:00
Next Scan 2025-10-23T15:10:56+00:00

Last Scan

Scanned2025-10-09T15:10:56+00:00
URL https://mitt.ca/robots.txt
Domain IPs 143.204.55.125, 143.204.55.59, 143.204.55.72, 143.204.55.75, 2600:9000:2837:1c00:f:2d7c:7ac0:93a1, 2600:9000:2837:200:f:2d7c:7ac0:93a1, 2600:9000:2837:2e00:f:2d7c:7ac0:93a1, 2600:9000:2837:a00:f:2d7c:7ac0:93a1, 2600:9000:2837:c00:f:2d7c:7ac0:93a1, 2600:9000:2837:de00:f:2d7c:7ac0:93a1, 2600:9000:2837:f200:f:2d7c:7ac0:93a1, 2600:9000:2837:fc00:f:2d7c:7ac0:93a1
Response IP 3.169.71.17
Found Yes
Hash c6853886720bbf55b211d1cbcd954243862e67c5bacf7d7a91d94d1f5a5e95c2
SimHash 2a3cd5e8e63b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /?s=
Disallow /search
Disallow /readme.html
Disallow /license.txt
Disallow /wp-json/wp/v2/
Disallow /*.php$
Disallow /*?*replytocom
Disallow /*?*orderby=
Disallow /*?*filter=
Disallow /*?*add-to-cart=
Disallow /*?*wc-ajax=
Disallow /*utm_*

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

Comments

  • Disallow common SEO scrapers, crawlers, and bots