sravni-labs.ru
robots.txt

Robots Exclusion Standard data for sravni-labs.ru

Resource Scan

Scan Details

Site Domain sravni-labs.ru
Base Domain sravni-labs.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-26T22:37:42+00:00
Next Scan 2026-02-24T22:37:42+00:00

Last Successful Scan

Scanned2024-01-13T08:08:11+00:00
URL https://sravni-labs.ru/robots.txt
Domain IPs 104.21.10.227, 172.67.146.241, 2606:4700:3031::6815:ae3, 2606:4700:3032::ac43:92f1
Response IP 172.67.146.241
Found Yes
Hash 2184a830531b8db7666cc8574fb54744792ad492305c1725a5c71afd8e0cdd15
SimHash 915d71604f31

Groups

*

Rule Path
Allow *.js
Allow *.css

baiduspider
blexbot
dotbot
emailcollector
emailsiphon
larbin
linkpadbot
moget
msiecrawler
mj12bot
npbot
npbot-1/2.0
nutch
offline explorer
psbot
semrushbot
sitesnagger
sogou spider
teleport
teleportpro
turnitinbot
webcopier
webstripper
trovitbot
trendictionbot
criteobot/0.1
linkdexbot

Rule Path
Disallow /