liputan.com
robots.txt
Robots Exclusion Standard data for liputan.com
Resource Scan
Scan Details
| Site Domain | liputan.com |
| Base Domain | liputan.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-22T10:09:42+00:00 |
| Next Scan | 2024-11-20T10:09:42+00:00 |
Last Successful Scan
| Scanned | 2023-07-07T10:02:59+00:00 |
| URL | http://liputan.com/robots.txt |
| Redirect | https://www.liputan6.com/robots.txt |
| Redirect Domain | www.liputan6.com |
| Redirect Base | liputan6.com |
| Domain IPs | 52.219.128.5 |
| Redirect IPs | 35.190.21.225 |
| Response IP | 35.190.21.225 |
| Found | Yes |
| Hash | 0e6a8bcb81d1bd84f2821be36d41c52054a830f30d41b5ab20987f6c1268d21c |
| SimHash | 6911c438af22 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /fimela/ |
| Disallow | */comment/ |
| Disallow | /ucnews/ |
| Disallow | /properti/ |
| Disallow | /widgets-nocache/analytics_page_request/* |
| Disallow | /login/ |
| Disallow | /dashboard/ |
| Disallow | /admin/ |
| Disallow | */livestreaming/ |
| Disallow | /articles/preview |
| Disallow | /gallery/ |
| Disallow | */indeks/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.liputan6.com/sitemap.xml |