skelet-info.mirtesen.ru
robots.txt

Robots Exclusion Standard data for skelet-info.mirtesen.ru

Resource Scan

Scan Details

Site Domain skelet-info.mirtesen.ru
Base Domain mirtesen.ru
Scan Status Ok
Last Scan2024-10-23T23:42:01+00:00
Next Scan 2024-11-06T23:42:01+00:00

Last Scan

Scanned2024-10-23T23:42:01+00:00
URL https://skelet-info.mirtesen.ru/robots.txt
Domain IPs 37.228.114.226, 82.148.14.146, 82.148.14.147, 82.148.14.152, 82.148.14.154, 95.213.193.172
Response IP 37.228.114.226
Found Yes
Hash 9c24db8b4d3bc848fec7f779cf88ad53b29d1351c17b8608d69d3336e3729763
SimHash 6c48dc519491

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://skelet-info.mirtesen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.