pointer.web.id
robots.txt

Robots Exclusion Standard data for pointer.web.id

Resource Scan

Scan Details

Site Domain pointer.web.id
Base Domain pointer.web.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-30T11:26:00+00:00
Next Scan 2025-08-28T11:26:00+00:00

Last Successful Scan

Scanned2023-08-10T08:36:04+00:00
URL https://pointer.web.id/robots.txt
Domain IPs 104.21.40.156, 172.67.154.102, 2606:4700:3034::6815:289c, 2606:4700:3037::ac43:9a66
Response IP 104.21.40.156
Found Yes
Hash 6954db0043060f61f417125185286beee87826328e0c19c08ee9c4a37fb4f277
SimHash 081ecd60ae9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://pointer.web.id/sitemap.xml