ontariotenants.ca
robots.txt

Robots Exclusion Standard data for ontariotenants.ca

Resource Scan

Scan Details

Site Domain ontariotenants.ca
Base Domain ontariotenants.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-07T16:15:39+00:00
Next Scan 2024-10-06T16:15:39+00:00

Last Successful Scan

Scanned2024-06-09T16:13:55+00:00
URL http://ontariotenants.ca/robots.txt
Domain IPs 204.15.190.195
Response IP 204.15.190.195
Found Yes
Hash be64056fe278fc2111c496e029518d7a1e7c19ebe68a44434bde976b485d6105
SimHash 38d85d56a880

Groups

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

freshbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

screamingfrog

Rule Path
Disallow /

screaming frog

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

datanyze

Rule Path
Disallow /

online-webceo-bot

Rule Path
Disallow /

*

Rule Path
Disallow /images/
Disallow /graphics/
Disallow /lawyers/
Disallow /web-statistics.phtml

Comments

  • User-agent: Screaming Frog SEO Spider
  • Disallow: /

Warnings

  • 2 invalid lines.