gramma.ru
robots.txt

Robots Exclusion Standard data for gramma.ru

Resource Scan

Scan Details

Site Domain gramma.ru
Base Domain gramma.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-09T20:12:55+00:00
Next Scan 2024-10-08T20:12:55+00:00

Last Successful Scan

Scanned2024-05-19T19:21:54+00:00
URL http://gramma.ru/robots.txt
Domain IPs 141.8.193.52
Response IP 141.8.193.52
Found Yes
Hash 6e2a6839379eb34408429761b6e371c5da7072225b8face9054018b27e67a86f
SimHash 4e505fe61675

Groups

yandexmedia

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

mediapartners

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

yandex
yandexbot

Rule Path
Disallow /FND/
Disallow /QWA/
Disallow /book/
Disallow /include/
Disallow /pics/
Disallow /pc/
Disallow /main/
Disallow /temp/
Disallow /ZIP/

googlebot

Rule Path
Disallow /FND/
Disallow /QWA/
Disallow /book/
Disallow /include/
Disallow /pics/
Disallow /pc/
Disallow /main/
Disallow /temp/
Disallow /ZIP/

*

Rule Path
Disallow /?ir=*
Disallow /FND/
Disallow /QWA/
Disallow /book/
Disallow /include/
Disallow /etc/
Disallow /pics/
Disallow /pc/
Disallow /main/
Disallow /temp/
Disallow /ZIP/

Other Records

Field Value
crawl-delay 10

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.