shuba.life
robots.txt
Robots Exclusion Standard data for shuba.life
Resource Scan
Scan Details
| Site Domain | shuba.life |
| Base Domain | shuba.life |
| Scan Status | Ok |
| Last Scan | 2024-11-10T22:42:00+00:00 |
| Next Scan | 2024-11-17T22:42:00+00:00 |
Last Scan
| Scanned | 2024-11-10T22:42:00+00:00 |
| URL | https://shuba.life/robots.txt |
| Domain IPs | 104.21.11.95, 172.67.148.154, 2606:4700:3030::ac43:949a, 2606:4700:3032::6815:b5f |
| Response IP | 104.21.11.95 |
| Found | Yes |
| Hash | 74ad717e2647c03eb74d8c9ef05dae99860fa2cc794d5e62ac11b0a325df3688 |
| SimHash | 590d5d55c3f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /control/ |
| Disallow | /search* |
| Disallow | /ru/search* |
| Disallow | /products/ |
| Disallow | /feed-products/ |
| Disallow | /recipes/*/ingredients/purchase |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shuba.life/sitemap.xml |
| sitemap | https://shuba.life/ru/sitemap.xml |
| sitemap | https://shuba.life/sitemap_index.xml |
| sitemap | https://shuba.life/ru/sitemap_index.xml |