aurobindo.ru
robots.txt

Robots Exclusion Standard data for aurobindo.ru

Resource Scan

Scan Details

Site Domain aurobindo.ru
Base Domain aurobindo.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-02T23:46:35+00:00
Next Scan 2025-05-31T23:46:35+00:00

Last Successful Scan

Scanned2023-10-17T21:18:53+00:00
URL https://aurobindo.ru/robots.txt
Redirect https://www.meedov.ru/robots.txt
Redirect Domain www.meedov.ru
Redirect Base meedov.ru
Domain IPs 104.21.36.144, 172.67.195.26, 2606:4700:3037::6815:2490, 2606:4700:3037::ac43:c31a
Redirect IPs 104.21.44.23, 172.67.193.246, 2606:4700:3031::6815:2c17, 2606:4700:3035::ac43:c1f6
Response IP 104.21.44.23
Found Yes
Hash 25659deabb38b4fb829925941fec6a7f9a5511b24f37c938d5a6948196806d98
SimHash 7d10b9704730

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */embed
Disallow */page/
Disallow */xmlrpc.php
Disallow *.pdf