Log In Sign Up

mtecbrakes.com
robots.txt

Robots Exclusion Standard data for mtecbrakes.com

Resource Scan

Scan Details

Site Domain mtecbrakes.com
Base Domain mtecbrakes.com
Scan Status Ok
Last Scan2024-09-28T02:19:02+00:00
Next Scan 2024-10-28T02:19:02+00:00

Last Scan

Scanned2024-09-28T02:19:02+00:00
URL https://mtecbrakes.com/robots.txt
Domain IPs 79.171.33.170
Response IP 79.171.33.170
Found Yes
Hash 059537a8e3d0d69416cdcb472bf43a35603ec4ddb657be8baef69fb502395359
SimHash 92f6d9306e28

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandex ( catchall )

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

link

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebot twitterbot

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top