glavnoe.life
robots.txt
Robots Exclusion Standard data for glavnoe.life
Resource Scan
Scan Details
Site Domain | glavnoe.life |
Base Domain | glavnoe.life |
Scan Status | Ok |
Last Scan | 2024-11-12T20:16:58+00:00 |
Next Scan | 2024-11-19T20:16:58+00:00 |
Last Scan
Scanned | 2024-11-12T20:16:58+00:00 |
URL | https://www.glavnoe.life/robots.txt |
Domain IPs | 104.26.6.47, 104.26.7.47, 172.67.73.219, 2606:4700:20::681a:62f, 2606:4700:20::681a:72f, 2606:4700:20::ac43:49db |
Response IP | 172.67.73.219 |
Found | Yes |
Hash | 3c14278e156d14583d1ae77367dc16d0c428e501f7d7539064fe09e9e44a6770 |
SimHash | 2dcd2e65af93 |
Groups
yandexbot
Rule | Path |
---|---|
Disallow | *.swf |
Disallow | /top/ |
Disallow | /news/embed/ |
Disallow | /en/celebrity/tag/ |
Disallow | /celebrity/search/ |
Disallow | /promocode/shops/search/ |
googlebot
Rule | Path |
---|---|
Disallow | *.swf |
Disallow | /top/ |
Disallow | /news/embed/ |
Disallow | /en/celebrity/tag/ |
Disallow | /celebrity/search/ |
Disallow | /promocode/shops/search/ |
*
Rule | Path |
---|---|
Disallow | *.swf |
Disallow | /top/ |
Disallow | /news/embed/ |
Disallow | /en/celebrity/tag/ |
Disallow | /celebrity/search/ |
Disallow | /promocode/shops/search/ |
Other Records
Field | Value |
---|---|
sitemap | https://24smi.org/sitemap.xml |
sitemap | https://24smi.org/image-sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.