vuodatus.net
robots.txt

Robots Exclusion Standard data for vuodatus.net

Resource Scan

Scan Details

Site Domain vuodatus.net
Base Domain vuodatus.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-07T13:36:29+00:00
Next Scan 2024-08-05T13:36:29+00:00

Last Successful Scan

Scanned2023-10-11T12:38:32+00:00
URL https://vuodatus.net/robots.txt
Domain IPs 104.26.4.220, 104.26.5.220, 172.67.74.217, 2606:4700:20::681a:4dc, 2606:4700:20::681a:5dc, 2606:4700:20::ac43:4ad9
Response IP 172.67.74.217
Found Yes
Hash fce6ed221e99b2367c46904ffb31a2e45b062dde8738960e6cb9df69e3c2461e
SimHash 626cf8e0c231

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 25

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bspider

Rule Path
Disallow /

slurp

Rule Path
Disallow /