vulkanrussia1.com
robots.txt

Robots Exclusion Standard data for vulkanrussia1.com

Resource Scan

Scan Details

Site Domain vulkanrussia1.com
Base Domain vulkanrussia1.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/7/2025, 12:32:41 AM
Next Scan 7/6/2025, 12:32:41 AM

Last Successful Scan

Scanned2/20/2024, 12:27:38 AM
URL https://vulkanrussia1.com/robots.txt
Domain IPs 104.21.57.147, 172.67.146.164, 2606:4700:3035::6815:3993, 2606:4700:3035::ac43:92a4
Response IP 104.21.57.147
Found Yes
Hash 19c5f5fbe6bb97d7318d51902026293328b3ebd3ed727a0767e7031d862a0515
SimHash 04301be3cf33

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Allow */uploads

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap http://vulkanrussia1.com/sitemap.xml

Warnings

  • `host` is not a known field.