msitec.com
robots.txt

Robots Exclusion Standard data for msitec.com

Resource Scan

Scan Details

Site Domain msitec.com
Base Domain msitec.com
Scan Status Ok
Last Scan2024-11-13T09:13:13+00:00
Next Scan 2024-12-13T09:13:13+00:00

Last Scan

Scanned2024-11-13T09:13:13+00:00
URL https://msitec.com/robots.txt
Domain IPs 192.124.249.17
Response IP 192.124.249.17
Found Yes
Hash f923b96d513046a43af210a99cae710feab57089f37b3808f840346692bceb38
SimHash fe46464dc876

Groups

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

bublupbot

Rule Path
Disallow /

cirkwi crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gpcsupbot

Rule Path
Disallow /

home project

Rule Path
Disallow /

kauaislowbot

Rule Path
Disallow /

lanaibot

Rule Path
Disallow /

leakix bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mybot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

odklbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rssingbot

Rule Path
Disallow /

re-re studio

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

tpradstxtcrawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

accompanybot

Rule Path
Disallow /

adbeat bot

Rule Path
Disallow /

bad-neighborhood

Rule Path
Disallow /

badbot

Rule Path
Disallow /

bnf.fr_bot

Rule Path
Disallow /

cg-eye

Rule Path
Disallow /

chimebot

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

crusty

Rule Path
Disallow /

csirt.cz

Rule Path
Disallow /

dautobot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

digitalpebble bot

Rule Path
Disallow /

fake bot

Rule Path
Disallow /

hinnavaatlus bot

Rule Path
Disallow /

hlidam.to robot

Rule Path
Disallow /

imgproxy

Rule Path
Disallow /

inetdex bot

Rule Path
Disallow /

ivre-masscan

Rule Path
Disallow /

jeffrey exif viewer

Rule Path
Disallow /

kazbtbot

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

mergadobot

Rule Path
Disallow /

metalinspector

Rule Path
Disallow /

mindupbot

Rule Path
Disallow /

moodlebot

Rule Path
Disallow /

netzzappen

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

pingadmin.ru

Rule Path
Disallow /

pr-cy.ru bot

Rule Path
Disallow /

punkspider

Rule Path
Disallow /

redhunt labs bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ruckrack

Rule Path
Disallow /

sebot-wa

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

seostar.co bot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

testbot

Rule Path
Disallow /

testomatobot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

tombot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

vuhuvbot

Rule Path
Disallow /

yetibot

Rule Path
Disallow /

zombiebot

Rule Path
Disallow /

*

Rule Path
Disallow /.env.example
Disallow /.env.testing
Disallow /.well-known
Disallow /.wp-config.php
Disallow /07
Disallow /15
Disallow /2020
Disallow /2021
Disallow /404javascript.js
Disallow /404testpage4525d2fdc
Disallow /?author
Disallow /_async
Disallow /administrator
Disallow /api
Disallow /assets
Disallow /css
Disallow /default
Disallow /en-GB
Disallow /festo
Disallow /gallery
Disallow /href
Disallow /language
Disallow /pa_test-attribute-sitemap
Disallow /photos
Disallow /shoppingcart
Disallow /specs
Disallow /type
Disallow /up
Disallow /up.php
Disallow /upload.php
Disallow /v
Disallow /vendors
Disallow /vspfiles
Disallow /wp-admin
Disallow /*.gz$
Disallow /*.php~$
Disallow /*.rar$
Disallow /*.swo$
Disallow /*.tgz$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Warnings

  • 2 invalid lines.