hai-online.com
robots.txt

Robots Exclusion Standard data for hai-online.com

Resource Scan

Scan Details

Site Domain hai-online.com
Base Domain hai-online.com
Scan Status Ok
Last Scan2024-05-26T14:11:57+00:00
Next Scan 2024-06-02T14:11:57+00:00

Last Scan

Scanned2024-05-26T14:11:57+00:00
URL http://hai-online.com/robots.txt
Redirect https://hai.grid.id:443/robots.txt
Redirect Domain hai.grid.id
Redirect Base grid.id
Domain IPs 13.228.160.144, 46.137.201.238
Redirect IPs 13.33.88.124, 13.33.88.3, 13.33.88.57, 13.33.88.76, 2600:9000:223b:1600:1d:e05e:fbc0:93a1, 2600:9000:223b:2600:1d:e05e:fbc0:93a1, 2600:9000:223b:3600:1d:e05e:fbc0:93a1, 2600:9000:223b:7c00:1d:e05e:fbc0:93a1, 2600:9000:223b:9e00:1d:e05e:fbc0:93a1, 2600:9000:223b:b800:1d:e05e:fbc0:93a1, 2600:9000:223b:d200:1d:e05e:fbc0:93a1, 2600:9000:223b:e00:1d:e05e:fbc0:93a1
Response IP 13.33.88.3
Found Yes
Hash 5e78c1acae297b3e282765efb745a1ff395ab522bc460b884c2adfe044ceff91
SimHash 69455840c113

Groups

*

Rule Path
Disallow /search/?keyword=*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hai.grid.id/sitemap.xml