spinus.info
robots.txt

Robots Exclusion Standard data for spinus.info

Resource Scan

Scan Details

Site Domain spinus.info
Base Domain spinus.info
Scan Status Ok
Last Scan2025-09-26T14:42:19+00:00
Next Scan 2025-10-26T14:42:19+00:00

Last Scan

Scanned2025-09-26T14:42:19+00:00
URL https://spinus.info/robots.txt
Domain IPs 67.20.112.81
Response IP 67.20.112.81
Found Yes
Hash bc0728c206ebf596122e7b3f564e07a3064176486b5fc1e0d50ae1334a3c338b
SimHash a5766a9047a3

Groups

*

Rule Path Comment
Allow /*sitemap -
Allow /*rss -
Allow /*type%3Drss -
Disallow /attachments/ -
Disallow /avatars/ -
Disallow /Packages/ -
Disallow /Smileys/ -
Disallow /Sources/ -
Disallow /Themes/ -
Disallow /Games/ -
Disallow /*.msg -
Disallow /*.new -
Disallow /*sort -
Disallow /*topicseen -
Disallow /*wap -
Disallow /*imode -
Disallow /*action -
Disallow /*prev_next -
Disallow /*all -
Disallow /*go.php ���� ��� �������� ��� ����� � ���

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100