vse2.indi-best.com
robots.txt

Robots Exclusion Standard data for vse2.indi-best.com

Resource Scan

Scan Details

Site Domain vse2.indi-best.com
Base Domain indi-best.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-02T01:01:10+00:00
Next Scan 2025-05-31T01:01:10+00:00

Last Successful Scan

Scanned2023-07-18T19:29:38+00:00
URL https://vse2.indi-best.com/robots.txt
Domain IPs 104.21.77.35, 172.67.204.3, 2606:4700:3030::ac43:cc03, 2606:4700:3031::6815:4d23
Response IP 104.21.77.35
Found Yes
Hash 9ad989ee908a886ee33d06bda4231268808ce2b1bf9b8bff59d48ed54bed7509
SimHash c3002a020a32

Groups

*

Rule Path
Disallow /xmlrpc.php
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow *wp-json
Disallow *?

Other Records

Field Value
sitemap https://msk.indi-best.com/sitemap_index.xml

Warnings

  • `host` is not a known field.