suar.grid.id
robots.txt

Robots Exclusion Standard data for suar.grid.id

Resource Scan

Scan Details

Site Domain suar.grid.id
Base Domain grid.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-24T19:44:41+00:00
Next Scan 2024-10-23T19:44:41+00:00

Last Successful Scan

Scanned2024-06-26T19:27:10+00:00
URL https://suar.grid.id/robots.txt
Domain IPs 13.33.88.124, 13.33.88.3, 13.33.88.57, 13.33.88.76, 2600:9000:223b:1000:1d:e05e:fbc0:93a1, 2600:9000:223b:200:1d:e05e:fbc0:93a1, 2600:9000:223b:3e00:1d:e05e:fbc0:93a1, 2600:9000:223b:9000:1d:e05e:fbc0:93a1, 2600:9000:223b:9200:1d:e05e:fbc0:93a1, 2600:9000:223b:a600:1d:e05e:fbc0:93a1, 2600:9000:223b:b800:1d:e05e:fbc0:93a1, 2600:9000:223b:ec00:1d:e05e:fbc0:93a1
Response IP 13.33.88.3
Found Yes
Hash cf7368e9b37d37c80ecd022146cd7e9f4681c5540456cb8b4fdcb894c773b3af
SimHash a145d8408113

Groups

*

Rule Path
Disallow /search/?keyword=*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://suar.grid.id/sitemap.xml