inomashina.ru
robots.txt

Robots Exclusion Standard data for inomashina.ru

Resource Scan

Scan Details

Site Domain inomashina.ru
Base Domain inomashina.ru
Scan Status Ok
Last Scan2024-08-30T22:14:14+00:00
Next Scan 2024-09-29T22:14:14+00:00

Last Scan

Scanned2024-08-30T22:14:14+00:00
URL https://inomashina.ru/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash c793397d303ba09ad028adb2e462625c90aa3408f5a588dacc307bc1e17058ee
SimHash 6d649bddc320

Groups

*

Rule Path
Allow /forum/$
Allow /forum/*type%3Drss
Allow /forum/*sitemap
Allow /forum/*bbs
Allow /forum/*faq
Allow /forum/*forum$
Allow /forum/*page*page
Allow /forum/*media$
Allow /forum/*media*item
Allow /forum/*media*album
Disallow /forum/*action
Disallow /forum/*wap
Disallow /forum/*imode
Disallow /forum/*board%3D*wap
Disallow /forum/*board%3D*imode
Disallow /forum/*topic%3D*wap
Disallow /forum/*topic%3D*imode
Disallow /forum/*topic%3D*.msg
Disallow /forum/*board%3D*.new
Disallow /forum/*PHPSESSID
Allow /forum/*board
Allow /forum/*topic
Disallow /forum/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

mediapartners-google

Rule Path
Allow /*

yadirectbot

Rule Path
Allow /*

googlebot-mobile

Rule Path
Allow /forum/*wap
Disallow /forum/

yandeximageresizer

Rule Path
Allow /forum/*wap
Disallow /forum/

Warnings

  • `host` is not a known field.