cerdasbelanja.grid.id
robots.txt

Robots Exclusion Standard data for cerdasbelanja.grid.id

Resource Scan

Scan Details

Site Domain cerdasbelanja.grid.id
Base Domain grid.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-26T05:43:13+00:00
Next Scan 2024-10-25T05:43:13+00:00

Last Successful Scan

Scanned2024-06-28T05:41:41+00:00
URL https://cerdasbelanja.grid.id/robots.txt
Domain IPs 13.35.18.25, 13.35.18.36, 13.35.18.42, 13.35.18.86, 2600:9000:20c7:2a00:1d:e05e:fbc0:93a1, 2600:9000:20c7:3800:1d:e05e:fbc0:93a1, 2600:9000:20c7:4600:1d:e05e:fbc0:93a1, 2600:9000:20c7:4e00:1d:e05e:fbc0:93a1, 2600:9000:20c7:8000:1d:e05e:fbc0:93a1, 2600:9000:20c7:8200:1d:e05e:fbc0:93a1, 2600:9000:20c7:8e00:1d:e05e:fbc0:93a1, 2600:9000:20c7:ca00:1d:e05e:fbc0:93a1
Response IP 13.35.18.36
Found Yes
Hash 2feea2f48081a7f5b8018f1f7182b2aa289e4206b413f3aca4535656346e4dfb
SimHash a145d8408913

Groups

*

Rule Path
Disallow /search/?keyword=*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cerdasbelanja.grid.id/sitemap.xml