hgspot.hr
robots.txt

Robots Exclusion Standard data for hgspot.hr

Resource Scan

Scan Details

Site Domain hgspot.hr
Base Domain hgspot.hr
Scan Status Ok
Last Scan2025-12-12T14:37:10+00:00
Next Scan 2026-01-11T14:37:10+00:00

Last Scan

Scanned2025-12-12T14:37:10+00:00
URL https://hgspot.hr/robots.txt
Redirect https://www.hgspot.hr/robots.txt
Redirect Domain www.hgspot.hr
Redirect Base hgspot.hr
Domain IPs 104.26.8.110, 104.26.9.110, 172.67.69.109, 2606:4700:20::681a:86e, 2606:4700:20::681a:96e, 2606:4700:20::ac43:456d
Redirect IPs 104.26.8.110, 104.26.9.110, 172.67.69.109, 2606:4700:20::681a:86e, 2606:4700:20::681a:96e, 2606:4700:20::ac43:456d
Response IP 104.26.8.110
Found Yes
Hash 9463d9eb966e7233f374e2f6349a1bd65d1be68a5201a8d8a0f867e0ee4bbd41
SimHash 4b18dc40c313

Groups

blexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.hgspot.hr/sitemap.xml