banktestov.ru
robots.txt

Robots Exclusion Standard data for banktestov.ru

Resource Scan

Scan Details

Site Domain banktestov.ru
Base Domain banktestov.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-11T03:08:16+00:00
Next Scan 2024-08-09T03:08:16+00:00

Last Successful Scan

Scanned2023-01-15T19:17:44+00:00
URL https://banktestov.ru/robots.txt
Domain IPs 87.103.202.252
Response IP 87.103.202.252
Found Yes
Hash 9ffcbeac9d90eeb9eb48b0c27af268e4d0ec20499c8a3bc3e693ffd38336cf52
SimHash 501486710f13

Groups

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

storm-based

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wget

Rule Path
Disallow /

npbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yandexdirect

Rule Path
Allow /showresult
Allow /profile

*

Rule Path
Disallow /edit
Disallow /logout
Disallow /profile
Disallow /login
Disallow /register
Disallow /registerconfirm
Disallow /showresult
Disallow */ratetest
Disallow /wid
Disallow /profile/setup
Disallow /profile/post
Disallow /underground
Disallow /search
Disallow /mobile/
Disallow /m/

Warnings

  • `host` is not a known field.