mypensiya.mirtesen.ru
robots.txt

Robots Exclusion Standard data for mypensiya.mirtesen.ru

Resource Scan

Scan Details

Site Domain mypensiya.mirtesen.ru
Base Domain mirtesen.ru
Scan Status Ok
Last Scan2024-10-22T06:27:17+00:00
Next Scan 2024-11-05T06:27:17+00:00

Last Scan

Scanned2024-10-22T06:27:17+00:00
URL https://mypensiya.mirtesen.ru/robots.txt
Domain IPs 37.228.114.226, 82.148.14.146, 82.148.14.147, 82.148.14.152, 82.148.14.154, 95.213.193.172
Response IP 82.148.14.146
Found Yes
Hash 9e322082934513a35e3ed60688ab9403bced2650e3761c396eb7d22e495f9317
SimHash 6c08d4559c93

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://mypensiya.mirtesen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.