dostoprimechatelnosti-online.ru
robots.txt

Robots Exclusion Standard data for dostoprimechatelnosti-online.ru

Resource Scan

Scan Details

Site Domain dostoprimechatelnosti-online.ru
Base Domain dostoprimechatelnosti-online.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-29T05:01:38+00:00
Next Scan 2024-12-28T05:01:38+00:00

Last Successful Scan

Scanned2024-02-09T23:25:14+00:00
URL https://dostoprimechatelnosti-online.ru/robots.txt
Domain IPs 90.156.205.94
Response IP 90.156.205.94
Found Yes
Hash 524ec19ee8bf83133cc86a5b3e5e22daa14bebdfe7bec0158df16a2d34183007
SimHash 401cd969ef13

Groups

*

Rule Path
Disallow /*?
Disallow *?place=%2F*
Disallow */go.php*
Disallow */tds.php*
Allow /css/*
Allow /js/*

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

riddler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /