zashibis.mirtesen.ru
robots.txt

Robots Exclusion Standard data for zashibis.mirtesen.ru

Resource Scan

Scan Details

Site Domain zashibis.mirtesen.ru
Base Domain mirtesen.ru
Scan Status Ok
Last Scan2024-10-25T01:25:11+00:00
Next Scan 2024-11-08T01:25:11+00:00

Last Scan

Scanned2024-10-25T01:25:11+00:00
URL https://zashibis.mirtesen.ru/robots.txt
Domain IPs 37.228.114.226, 82.148.14.146, 82.148.14.147, 82.148.14.152, 82.148.14.154, 95.213.193.172
Response IP 82.148.14.146
Found Yes
Hash a603dacd34935a4f0b9f8a01d1b2879dce82e650b393b5005c400784f82a1c88
SimHash 4c48dc559491

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://zashibis.mirtesen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.