rain-tree.com
robots.txt

Robots Exclusion Standard data for rain-tree.com

Resource Scan

Scan Details

Site Domain rain-tree.com
Base Domain rain-tree.com
Scan Status Ok
Last Scan2024-05-22T02:56:29+00:00
Next Scan 2024-06-21T02:56:29+00:00

Last Scan

Scanned2024-05-22T02:56:29+00:00
URL https://rain-tree.com/robots.txt
Domain IPs 74.124.193.16
Response IP 74.124.193.16
Found Yes
Hash 96c89c65256449b244c0de61658de25222050d831753bb92e21b56ec5535acd8
SimHash 1af4cf828b19

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexcatalog

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow

Comments

  • Baiduspider
  • Yandex
  • All robots will spider the domain