receptculinar.ru
robots.txt

Robots Exclusion Standard data for receptculinar.ru

Resource Scan

Scan Details

Site Domain receptculinar.ru
Base Domain receptculinar.ru
Scan Status Ok
Last Scan2024-11-11T12:28:07+00:00
Next Scan 2024-11-18T12:28:07+00:00

Last Scan

Scanned2024-11-11T12:28:07+00:00
URL https://receptculinar.ru/robots.txt
Redirect https://s30799342005.mirtesen.ru/robots.txt
Redirect Domain s30799342005.mirtesen.ru
Redirect Base mirtesen.ru
Domain IPs 95.131.27.119
Redirect IPs 37.228.114.226, 82.148.14.146, 82.148.14.147, 82.148.14.152, 82.148.14.154, 95.213.193.172
Response IP 82.148.14.154
Found Yes
Hash 1361c0db6f4fe6fbe26cdff1463e3d65d73d0c74962fe339133641502969dae0
SimHash 6808d4559491

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://s30799342005.mirtesen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.