cosmo.ph
robots.txt
Robots Exclusion Standard data for cosmo.ph
Resource Scan
Scan Details
| Site Domain | cosmo.ph |
| Base Domain | cosmo.ph |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-28T00:31:25+00:00 |
| Next Scan | 2024-11-27T00:31:25+00:00 |
Last Successful Scan
| Scanned | 2024-07-31T00:18:53+00:00 |
| URL | https://cosmo.ph/robots.txt |
| Redirect | https://www.cosmo.ph/robots.txt |
| Redirect Domain | www.cosmo.ph |
| Redirect Base | cosmo.ph |
| Domain IPs | 104.18.24.158, 104.18.25.158, 2606:4700::6812:189e, 2606:4700::6812:199e |
| Redirect IPs | 104.18.24.158, 104.18.25.158, 2606:4700::6812:189e, 2606:4700::6812:199e |
| Response IP | 104.18.24.158 |
| Found | Yes |
| Hash | 60563d16f7811dc994240c950d8735b7776603ea96e20211c573f4a699b2c29a |
| SimHash | 402e5204ad13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app |
| Disallow | /vendor |
| Disallow | /api |
| Disallow | /board |
| Disallow | /objects |
| Disallow | /templates |
| Disallow | /entertainment/oprah-michelle-obama-becoming-interview-src-intl-a2729-20181114-lfrm5 |
| Disallow | /lifestyle/career-money/jonha-richman-blockchain-financial-technology-a704-20190606 |
| Disallow | /tag/jonha-richman |
| Disallow | /admin.php |
| Disallow | /entertainment/pinoy-stylist-the-king-eternal-monarch-a2520-20200414 |
| Disallow | /generation-glow/admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cosmo.ph/sitemap-main.xml |
| sitemap | https://www.cosmo.ph/sitemap.xml |
| sitemap | https://www.cosmo.ph/sitemaps/cosmopolitan/sitemap-amp.xml |