inilah.com
robots.txt

Robots Exclusion Standard data for inilah.com

Resource Scan

Scan Details

Site Domain inilah.com
Base Domain inilah.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-23T16:09:22+00:00
Next Scan 2024-11-21T16:09:22+00:00

Last Successful Scan

Scanned2024-01-27T15:56:40+00:00
URL https://inilah.com/robots.txt
Domain IPs 104.26.14.52, 104.26.15.52, 172.67.71.148, 2606:4700:20::681a:e34, 2606:4700:20::681a:f34, 2606:4700:20::ac43:4794
Response IP 172.67.71.148
Found Yes
Hash f7281f82f3fe7fcd97f264c3f85fcfa10d18af491b15cc367395cd335c419c9d
SimHash 61500e56ed32

Groups

*

Rule Path
Allow /api/v1/sitemap/
Disallow /api/
Disallow /dashboard/
Disallow /nulis/
Disallow /kemendag/
Disallow /pemilu/

Other Records

Field Value
sitemap https://www.inilah.com/api/v1/sitemap/index.xml