vesti72.ru
robots.txt
Robots Exclusion Standard data for vesti72.ru
Resource Scan
Scan Details
Site Domain | vesti72.ru |
Base Domain | vesti72.ru |
Scan Status | Ok |
Last Scan | 2024-09-29T06:26:50+00:00 |
Next Scan | 2024-10-06T06:26:50+00:00 |
Last Scan
Scanned | 2024-09-29T06:26:50+00:00 |
URL | https://vesti72.ru/robots.txt |
Domain IPs | 95.217.144.15 |
Response IP | 95.217.144.15 |
Found | Yes |
Hash | 37ebdbc78a399ee3865568cbd095a1926ef39f8b7d79aa6cc60919fe8b1ffc15 |
SimHash | b31f1d5e4bf5 |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /templates/ |
Disallow | /tmp/ |
Disallow | /ads.txt |
Disallow | /url.php* |
Disallow | /*?limitstart=0* |
Disallow | /sitemap.php* |
Disallow | /component/adsmanager/* |
Disallow | /component/mailto/* |
Disallow | /component/* |
Disallow | /*?type=rss* |
Disallow | /*.feed* |
Disallow | /*84-posts* |
Allow | /component/users/* |
Other Records
Field | Value |
---|---|
sitemap | https://vesti72.ru/sitemap.xml |
Warnings
- `host` is not a known field.
Comments