Log In Sign Up

m24.ru
robots.txt

Robots Exclusion Standard data for m24.ru

Resource Scan

Scan Details

Site Domain m24.ru
Base Domain m24.ru
Scan Status Ok
Last Scan2024-11-16T03:16:30+00:00
Next Scan 2024-11-23T03:16:30+00:00

Last Scan

Scanned2024-11-16T03:16:30+00:00
URL https://m24.ru/robots.txt
Redirect https://www.m24.ru/robots.txt
Redirect Domain www.m24.ru
Redirect Base m24.ru
Domain IPs 195.42.165.43, 195.42.165.46, 95.213.215.36
Redirect IPs 195.42.165.43, 195.42.165.45, 195.42.165.46, 195.42.165.47, 95.213.215.36
Response IP 195.42.165.47
Found Yes
Hash a716aad6a11e2f691f40c24997454bae03b3109a6297b83212a1c05142f5583c
SimHash 6b830c128b97

Groups

*

Rule Path
Disallow /sphinx
Disallow /special/beta/*
Disallow /vfiles*
Disallow /api/*
Disallow /cameras/*
Disallow /camera*
Disallow *test*
Disallow *cms*
Disallow *wknd*
Disallow *html/widgets*
Disallow /cameras/*
Disallow /special/custom/*
Disallow /special/QR/*
Disallow /cams/*
Disallow /map*
Disallow /large*
Disallow */special/sberbank*
Disallow /amp/games/*
Disallow *external*
Disallow *embed*
Disallow */news/transport/22042022/454258
Disallow */videos/obshchestvo/15062021/294982
Disallow */videos/obshchestvo/14062021/294925
Disallow */videos/obshchestvo/14062021/294917
Disallow */videos/obshchestvo/14062021/294913
Disallow */videos/obshchestvo/14062021/294908
Disallow */news/obshchestvo/25082021/179555*
Disallow */videos/za-rubezhom/30082021/305622*
Disallow */news/turizm/12102021/187314*
Disallow */authors/1
Disallow */news/transport/01112021/190210
Disallow */news/tehnologii/17122021/196763*
Disallow */obshchestvo/15122021/321198
Disallow */videos/transport/19012022/326113*
Disallow */videos/ehkonomika/24012022/326720*
Disallow */news/gorod/26012022/201984*
Disallow */shows1/21/436236
Disallow */news/kultura/03032022/436476
Disallow */videos/politika/04032022/437125
Disallow */shows1/21/436220*
Disallow */shows1/21/436203*
Disallow */shows1/21/436171*
Disallow */shows1/21/435798*
Disallow */shows1/21/435778*
Disallow */shows1/21/435763*
Disallow */shows1/21/435731*
Disallow */shows1/21/435373*
Disallow */shows1/21/435330*
Disallow */shows1/21/435296*
Disallow */shows1/21/434317*
Disallow */shows1/21/434300*
Disallow */shows1/21/434278*
Disallow */shows1/21/434253*
Disallow */shows1/21/433739*
Disallow */shows1/21/433532*
Disallow */shows1/21/433510*
Disallow */shows1/21/433525*
Disallow */shows1/21/433538*
Disallow */videos/politika/01042022/446766
Disallow */videos/obshchestvo/01042022/446820
Disallow */videos/politika/31032022/446418
Disallow */videos/shou-biznes/01022022/327907
Disallow */videos/obshchestvo/01022022/327922
Disallow */news/tehnologii/12042022/450547
Disallow */video/19032018/169810
Disallow */special/s/tarif-docs*
Disallow */videos/turizm/24022013/12726
Disallow */news/samoubijstvo/16052013/6387
Disallow */articles/kultura/19022016/97876
Disallow */articles/obshchestvo/27012016/95680
Disallow */articles/smena-pola/09032016/99243
Disallow */videos/video/14052019/205350
Disallow */articles/bezopasnost/16112017/151555
Disallow */articles/Velikobritaniya/10012017/126932
Disallow */videos/novosti/18112016/129904
Disallow */news/kultura/25052021/166808
Disallow */news/za-rubezhom/23122022/534766
Disallow */news/za-rubezhom/04082022/487968
Disallow */news/politika/28052019/77848
Disallow */news/sport/02082021/176404
Disallow */news/sport/03082021/176576
Disallow */videos/za-rubezhom/02072021/297572
Disallow */news/sport/06052021/164222
Disallow */videos/za-rubezhom/25032021/283367
Disallow */videos/video/03062019/207025
Disallow */news/politika/15032024/674467
Disallow */authors/106
Disallow */shows1/185/710918

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.m24.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
  • `request-rate` is not a known field.
Back to top