anidubs.ru
robots.txt

Robots Exclusion Standard data for anidubs.ru

Resource Scan

Scan Details

Site Domain anidubs.ru
Base Domain anidubs.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/1/2025, 11:18:54 AM
Next Scan 6/30/2025, 11:18:54 AM

Last Successful Scan

Scanned12/3/2024, 1:05:54 AM
URL https://anidubs.ru/robots.txt
Redirect https://anidubis.ru/robots.txt
Redirect Domain anidubis.ru
Redirect Base anidubis.ru
Domain IPs 104.21.27.85, 172.67.169.18
Redirect IPs 104.21.91.130, 172.67.219.205
Response IP 104.21.91.130
Found Yes
Hash ca6a91f4d368bc7ff854c686bcad4810e2a73dbd85ae64f6bf8e5cbdcdede344
SimHash fd09b0788131

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo