cerpen.id
robots.txt
Robots Exclusion Standard data for cerpen.id
Resource Scan
Scan Details
| Site Domain | cerpen.id |
| Base Domain | cerpen.id |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-11T01:12:11+00:00 |
| Next Scan | 2026-03-11T01:12:11+00:00 |
Last Successful Scan
| Scanned | 2025-08-11T21:51:25+00:00 |
| URL | https://cerpen.id/robots.txt |
| Redirect | https://www.cerpen.id/robots.txt |
| Redirect Domain | www.cerpen.id |
| Redirect Base | cerpen.id |
| Domain IPs | 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21 |
| Redirect IPs | 142.251.12.121, 2404:6800:4003:c05::79 |
| Response IP | 142.251.12.121 |
| Found | Yes |
| Hash | 8256431bc58bc811c427a93c348c1a2b71d21192210fed8089a5355a5bf20285 |
| SimHash | 4944d2505753 |
Groups
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cerpen.id/sitemap.xml |