dom-u-morya.su
robots.txt

Robots Exclusion Standard data for dom-u-morya.su

Resource Scan

Scan Details

Site Domain dom-u-morya.su
Base Domain dom-u-morya.su
Scan Status Ok
Last Scan2025-11-07T22:12:16+00:00
Next Scan 2025-12-07T22:12:16+00:00

Last Scan

Scanned2025-11-07T22:12:16+00:00
URL https://dom-u-morya.su/robots.txt
Domain IPs 87.236.16.32
Response IP 87.236.16.32
Found Yes
Hash da5181bd94845ebfd25be5377c09c94a29a464e23deb01c4250947ce8c204d5b
SimHash 6a154540c5b0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-json/
Disallow /wp*
Disallow */?tab=*

yandex
bingbot
msnbot
stackrambler
aport
scooter
yahoobot
metaspider
ahrefsbot
slurp
googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dom-u-morya.su/sitemap_index.xml

Comments

  • User-agent: YaDirectFetcher
  • Disallow: /
  • Disallow: /*.gif$ # запрет на gif
  • Disallow: /*.png$

Warnings

  • `host` is not a known field.