cosmopolitan.co.id
robots.txt
Robots Exclusion Standard data for cosmopolitan.co.id
Resource Scan
Scan Details
| Site Domain | cosmopolitan.co.id |
| Base Domain | cosmopolitan.co.id |
| Scan Status | Ok |
| Last Scan | 2024-06-10T00:57:32+00:00 |
| Next Scan | 2024-06-17T00:57:32+00:00 |
Last Scan
| Scanned | 2024-06-10T00:57:32+00:00 |
| URL | https://cosmopolitan.co.id/robots.txt |
| Redirect | https://www.cosmopolitan.co.id/robots.txt |
| Redirect Domain | www.cosmopolitan.co.id |
| Redirect Base | cosmopolitan.co.id |
| Domain IPs | 128.199.248.140 |
| Redirect IPs | 128.199.248.140 |
| Response IP | 128.199.248.140 |
| Found | Yes |
| Hash | af52681908661ca24fb1433b5f6af5a74335f7fc2556914df5c6bf4a6e3afe36 |
| SimHash | 1f31d0f9adf3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tag* |
| Disallow | /search-result* |
| Disallow | /auth* |
| Disallow | /channel* |
| Disallow | /sub-channel* |
| Disallow | /author* |
| Disallow | /category* |
| Disallow | /sign-out* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cosmopolitan.co.id/sitemap.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap1.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap2.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap3.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap4.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap5.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap6.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap7.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap8.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap9.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap10.xml |
| sitemap | https://www.cosmopolitan.co.id/sitemap11.xml |