inilah.com
robots.txt
Robots Exclusion Standard data for inilah.com
Resource Scan
Scan Details
Site Domain | inilah.com |
Base Domain | inilah.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-23T16:09:22+00:00 |
Next Scan | 2024-11-21T16:09:22+00:00 |
Last Successful Scan
Scanned | 2024-01-27T15:56:40+00:00 |
URL | https://inilah.com/robots.txt |
Domain IPs | 104.26.14.52, 104.26.15.52, 172.67.71.148, 2606:4700:20::681a:e34, 2606:4700:20::681a:f34, 2606:4700:20::ac43:4794 |
Response IP | 172.67.71.148 |
Found | Yes |
Hash | f7281f82f3fe7fcd97f264c3f85fcfa10d18af491b15cc367395cd335c419c9d |
SimHash | 61500e56ed32 |
Groups
*
Rule | Path |
---|---|
Allow | /api/v1/sitemap/ |
Disallow | /api/ |
Disallow | /dashboard/ |
Disallow | /nulis/ |
Disallow | /kemendag/ |
Disallow | /pemilu/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.inilah.com/api/v1/sitemap/index.xml |