moikaspiysk.ru
robots.txt

Robots Exclusion Standard data for moikaspiysk.ru

Resource Scan

Scan Details

Site Domain moikaspiysk.ru
Base Domain moikaspiysk.ru
Scan Status Ok
Last Scan2024-11-19T10:01:19+00:00
Next Scan 2024-12-19T10:01:19+00:00

Last Scan

Scanned2024-11-19T10:01:19+00:00
URL http://moikaspiysk.ru/robots.txt
Domain IPs 2a03:6f00:1::5c35:6099, 92.53.96.153
Response IP 92.53.96.153
Found Yes
Hash 4abe75afae3f2e21a9db85109b9354ef0ad7dd94ab949cddab3db6f53117a4d6
SimHash 277d65b0e28a

Groups

*

Rule Path
Disallow /components/
Disallow /includes/
Disallow /modules/
Disallow /filters/
Disallow /languages/
Disallow /users/
Disallow /login/
Disallow /registration/

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

statdom.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

webdatastats

Rule Path
Disallow /

jooblebot

Rule Path
Disallow /

backupland

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

openstat.ru

Rule Path
Disallow /