cosmosweet.com
robots.txt
Robots Exclusion Standard data for cosmosweet.com
Resource Scan
Scan Details
| Site Domain | cosmosweet.com |
| Base Domain | cosmosweet.com |
| Scan Status | Ok |
| Last Scan | 2025-09-07T14:54:10+00:00 |
| Next Scan | 2025-09-14T14:54:10+00:00 |
Last Scan
| Scanned | 2025-09-07T14:54:10+00:00 |
| URL | https://cosmosweet.com/robots.txt |
| Domain IPs | 104.21.78.244, 172.67.138.188, 2606:4700:3037::6815:4ef4, 2606:4700:3037::ac43:8abc |
| Response IP | 104.21.78.244 |
| Found | Yes |
| Hash | 2b13ee66c159ec8cc0c1fe7f0e0f58ff49009387d51ec0e02488db727ec97160 |
| SimHash | ac12cd058727 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /saved/ |
| Disallow | /404/** |
| Disallow | /subscription-status |
| Disallow | /en/subscription-status/ |
| Disallow | /pl/subscription-status/ |
| Disallow | /uk/subscription-status/ |
| Disallow | /tr/subscription-status/ |
| Disallow | /fr/subscription-status/ |
| Disallow | /it/subscription-status/ |
| Disallow | /de/subscription-status/ |
| Disallow | /es/subscription-status/ |
| Disallow | /pt/subscription-status/ |
| Disallow | /ru/subscription-status/ |
| Disallow | /my-profile |
| Disallow | /en/my-profile/ |
| Disallow | /pl/my-profile/ |
| Disallow | /tr/my-profile/ |
| Disallow | /fr/my-profile/ |
| Disallow | /it/my-profile/ |
| Disallow | /de/my-profile/ |
| Disallow | /es/my-profile/ |
| Disallow | /pt/my-profile/ |
| Disallow | /ru/my-profile/ |
| Disallow | /en/create |
| Disallow | /pl/create |
| Disallow | /tr/create |
| Disallow | /fr/create |
| Disallow | /it/create |
| Disallow | /de/create |
| Disallow | /es/create |
| Disallow | /pt/create |
| Disallow | /ru/create |
| Disallow | /create |
| Disallow | /unverified-items |
| Disallow | /en/unverified-items/ |
| Disallow | /pl/unverified-items/ |
| Disallow | /tr/unverified-items/ |
| Disallow | /fr/unverified-items/ |
| Disallow | /it/unverified-items/ |
| Disallow | /de/unverified-items/ |
| Disallow | /es/unverified-items/ |
| Disallow | /pt/unverified-items/ |
| Disallow | /ru/unverified-items/ |
| Disallow | /added-items |
| Disallow | /pl/added-items/ |
| Disallow | /en/added-items/ |
| Disallow | /tr/added-items/ |
| Disallow | /fr/added-items/ |
| Disallow | /it/added-items/ |
| Disallow | /de/added-items/ |
| Disallow | /es/added-items/ |
| Disallow | /pt/added-items/ |
| Disallow | /ru/added-items/ |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cosmosweet.com/sitemap.xml |
| sitemap | https://cosmosweet.com/server-sitemap-index.xml |
Warnings
- `host` is not a known field.
Comments