hai.grid.id
robots.txt

Robots Exclusion Standard data for hai.grid.id

Resource Scan

Scan Details

Site Domain hai.grid.id
Base Domain grid.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-25T07:48:56+00:00
Next Scan 2024-10-24T07:48:56+00:00

Last Successful Scan

Scanned2024-06-27T07:47:50+00:00
URL https://hai.grid.id/robots.txt
Domain IPs 13.35.18.25, 13.35.18.36, 13.35.18.42, 13.35.18.86, 2600:9000:20c7:1200:1d:e05e:fbc0:93a1, 2600:9000:20c7:3800:1d:e05e:fbc0:93a1, 2600:9000:20c7:9000:1d:e05e:fbc0:93a1, 2600:9000:20c7:a600:1d:e05e:fbc0:93a1, 2600:9000:20c7:a800:1d:e05e:fbc0:93a1, 2600:9000:20c7:c800:1d:e05e:fbc0:93a1, 2600:9000:20c7:ce00:1d:e05e:fbc0:93a1, 2600:9000:20c7:ee00:1d:e05e:fbc0:93a1
Response IP 13.35.18.86
Found Yes
Hash 5e78c1acae297b3e282765efb745a1ff395ab522bc460b884c2adfe044ceff91
SimHash 69455840c113

Groups

*

Rule Path
Disallow /search/?keyword=*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hai.grid.id/sitemap.xml