populis.id
robots.txt
Robots Exclusion Standard data for populis.id
Resource Scan
Scan Details
Site Domain | populis.id |
Base Domain | populis.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-27T20:22:49+00:00 |
Next Scan | 2025-01-25T20:22:49+00:00 |
Last Successful Scan
Scanned | 2023-04-07T19:44:23+00:00 |
URL | https://populis.id/robots.txt |
Domain IPs | 13.33.88.18, 13.33.88.20, 13.33.88.49, 13.33.88.64, 2600:9000:20db:3000:19:52dd:8b80:93a1, 2600:9000:20db:5800:19:52dd:8b80:93a1, 2600:9000:20db:5e00:19:52dd:8b80:93a1, 2600:9000:20db:6800:19:52dd:8b80:93a1, 2600:9000:20db:a800:19:52dd:8b80:93a1, 2600:9000:20db:b600:19:52dd:8b80:93a1, 2600:9000:20db:ce00:19:52dd:8b80:93a1, 2600:9000:20db:da00:19:52dd:8b80:93a1 |
Response IP | 13.33.88.20 |
Found | Yes |
Hash | 9e829aa8dcc738522c68c32829251ad409c428338e5d4ded9a63c1516788adfb |
SimHash | 411c8d53e513 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/ |
Disallow | /search/?q=* |
Disallow | /cdn-cgi/ |
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://populis.id/sitemap.xml |