arsenalcom.ru
robots.txt

Robots Exclusion Standard data for arsenalcom.ru

Resource Scan

Scan Details

Site Domain arsenalcom.ru
Base Domain arsenalcom.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-19T21:23:36+00:00
Next Scan 2026-03-20T21:23:36+00:00

Last Successful Scan

Scanned2025-11-20T22:57:45+00:00
URL https://arsenalcom.ru/robots.txt
Domain IPs 213.171.17.85, 2a06:dd00:30:2:127c:61ff:fed3:e725
Response IP 213.171.17.85
Found Yes
Hash cabda4a4747b82f6c290e3688b5671d24d687c23f4eba8bacbd3e95a665acb68
SimHash 207141444334

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow *?*
Disallow */feed
Disallow /xmlrpc.php
Disallow */page/
Disallow /tag/
Disallow */trackback
Disallow /author/*
Disallow /201*
Disallow /comment-page*
Allow */uploads
Allow *.js
Allow *.css