s30922891521.mirtesen.ru
robots.txt

Robots Exclusion Standard data for s30922891521.mirtesen.ru

Resource Scan

Scan Details

Site Domain s30922891521.mirtesen.ru
Base Domain mirtesen.ru
Scan Status Ok
Last Scan2024-11-15T20:51:28+00:00
Next Scan 2024-11-29T20:51:28+00:00

Last Scan

Scanned2024-11-15T20:51:28+00:00
URL https://s30922891521.mirtesen.ru/robots.txt
Domain IPs 37.228.114.226, 82.148.14.146, 82.148.14.147, 82.148.14.152, 82.148.14.154, 95.213.193.172
Response IP 95.213.193.172
Found Yes
Hash a5912430ff17696b3baf209f5a73c4a22f0426d79bae718c1cdf784112e49673
SimHash 4848d4559493

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://s30922891521.mirtesen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.