gruzovod.ru
robots.txt
Robots Exclusion Standard data for gruzovod.ru
Resource Scan
Scan Details
Site Domain | gruzovod.ru |
Base Domain | gruzovod.ru |
Scan Status | Ok |
Last Scan | 2024-11-19T02:10:10+00:00 |
Next Scan | 2024-11-26T02:10:10+00:00 |
Last Scan
Scanned | 2024-11-19T02:10:10+00:00 |
URL | https://gruzovod.ru/robots.txt |
Domain IPs | 185.221.154.133 |
Response IP | 185.221.154.133 |
Found | Yes |
Hash | 11184a34164592005d900bdb95e54d4f4afc244a260659493b6fe42ef72d1597 |
SimHash | 2432d8ac02a6 |
Groups
*
Rule | Path |
---|---|
Disallow | /?* |
Disallow | /adm |
Disallow | /cache |
Disallow | /docs |
Disallow | /files |
Disallow | /includes |
Disallow | /install |
Disallow | /language |
Disallow | /store |
Disallow | /app.php |
Disallow | /common.php |
Disallow | /config.php |
Disallow | /cron.php |
Disallow | /faq.php |
Disallow | /feed.php |
Disallow | /mcp.php |
Disallow | /posting.php |
Disallow | /report.php |
Disallow | /ucp.php |
Disallow | /viewonline.php |
Disallow | /index.php |
Disallow | /memberlist.php |
Disallow | /search.php |
Disallow | /viewtopic.php/*viewtopic.php?* |
Disallow | /viewtopic.php?p=* |
Disallow | /viewtopic.php?f=*&t=* |
Disallow | /viewtopic.php?t=*p=* |
Disallow | /viewtopic.php?f=*p=* |
Disallow | /viewtopic.php?t=*&start=0$ |
Disallow | /viewtopic.php?f=*&start=0$ |
Disallow | /viewtopic.php?*&view=viewpoll |
Disallow | /*%26st%3D* |
Disallow | /*%26sk%3D* |
Disallow | /*%26sd%3D* |
Disallow | /*%26hilit%3D* |
Disallow | /*%26view%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://gruzovod.ru/sitemap.xml |