mazda-auto.ru
robots.txt

Robots Exclusion Standard data for mazda-auto.ru

Resource Scan

Scan Details

Site Domain mazda-auto.ru
Base Domain mazda-auto.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-18T23:16:25+00:00
Next Scan 2024-10-02T23:16:25+00:00

Last Successful Scan

Scanned2024-09-03T05:43:32+00:00
URL http://mazda-auto.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:7:6263, 2a00:15f8:a000:5:1:12:7:6263, 2a00:15f8:a000:5:1:13:7:6263, 2a00:15f8:a000:5:1:14:7:6263, 90.156.201.110, 90.156.201.114, 90.156.201.21, 90.156.201.38
Response IP 90.156.201.110
Found Yes
Hash 795396e3d4d7f1c2adc47c907b8210f3ce46e8f6e32da370676a33c9f4c2ca58
SimHash 68587e849214

Groups

*

Rule Path
Disallow /memberlist.php
Disallow /posting.php
Disallow /search.php
Disallow /faq.php
Disallow /ucp.php
Disallow /garage.php
Disallow /index.html
Disallow /download.php
Disallow /read.php
Disallow /profile.php
Disallow /portal.php
Disallow /gallery/
Disallow /*?text2find
Disallow /autonews/engine/go.php
Disallow /autonews/user/
Disallow /autonews/newposts/
Disallow /autonews/statistics.html
Disallow /autonews/*subaction%3Duserinfo
Disallow /autonews/*subaction%3Dnewposts
Disallow /autonews/*do%3Dlastcomments
Disallow /autonews/*do%3Dfeedback
Disallow /autonews/*do%3Dregister
Disallow /autonews/*do%3Dlostpassword
Disallow /autonews/*do%3Daddnews
Disallow /autonews/*do%3Dstats
Disallow /autonews/*do%3Dpm
Disallow /autonews/*print
Disallow

slurp

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.