glavnoe.life
robots.txt

Robots Exclusion Standard data for glavnoe.life

Resource Scan

Scan Details

Site Domain glavnoe.life
Base Domain glavnoe.life
Scan Status Ok
Last Scan2024-11-12T20:16:58+00:00
Next Scan 2024-11-19T20:16:58+00:00

Last Scan

Scanned2024-11-12T20:16:58+00:00
URL https://www.glavnoe.life/robots.txt
Domain IPs 104.26.6.47, 104.26.7.47, 172.67.73.219, 2606:4700:20::681a:62f, 2606:4700:20::681a:72f, 2606:4700:20::ac43:49db
Response IP 172.67.73.219
Found Yes
Hash 3c14278e156d14583d1ae77367dc16d0c428e501f7d7539064fe09e9e44a6770
SimHash 2dcd2e65af93

Groups

yandexbot

Rule Path
Disallow *.swf
Disallow /top/
Disallow /news/embed/
Disallow /en/celebrity/tag/
Disallow /celebrity/search/
Disallow /promocode/shops/search/

googlebot

Rule Path
Disallow *.swf
Disallow /top/
Disallow /news/embed/
Disallow /en/celebrity/tag/
Disallow /celebrity/search/
Disallow /promocode/shops/search/

*

Rule Path
Disallow *.swf
Disallow /top/
Disallow /news/embed/
Disallow /en/celebrity/tag/
Disallow /celebrity/search/
Disallow /promocode/shops/search/

Other Records

Field Value
sitemap https://24smi.org/sitemap.xml
sitemap https://24smi.org/image-sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.