express-novosti.ru
robots.txt

Robots Exclusion Standard data for express-novosti.ru

Resource Scan

Scan Details

Site Domain express-novosti.ru
Base Domain express-novosti.ru
Scan Status Ok
Last Scan2024-11-09T18:38:07+00:00
Next Scan 2024-11-16T18:38:07+00:00

Last Scan

Scanned2024-11-09T18:38:07+00:00
URL https://express-novosti.ru/robots.txt
Domain IPs 62.173.138.180
Response IP 62.173.138.180
Found Yes
Hash 272e42054b0de09cb5f6dc1eb517c558b848a9d00f016785ee1839c668587042
SimHash 191e18468795

Groups

yandex

Rule Path
Disallow /amp
Disallow /menage
Disallow /upload
Disallow /404.php
Disallow */test/*
Disallow *?*
Allow *?s=

googlebot

Rule Path
Disallow /menage
Disallow /upload
Disallow /404.php
Disallow */test/*

*

Rule Path
Disallow /menage
Disallow /upload
Disallow /404.php
Disallow */test/*
Disallow */rf/*
Disallow /rss/

textmediasitebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://express-novosti.ru/sitemap.xml