gol.hr
robots.txt

Robots Exclusion Standard data for gol.hr

Resource Scan

Scan Details

Site Domain gol.hr
Base Domain gol.hr
Scan Status Ok
Last Scan2024-06-13T04:15:13+00:00
Next Scan 2024-06-20T04:15:13+00:00

Last Scan

Scanned2024-06-13T04:15:13+00:00
URL https://gol.hr/robots.txt
Redirect https://gol.dnevnik.hr/robots.txt
Redirect Domain gol.dnevnik.hr
Redirect Base dnevnik.hr
Domain IPs 104.26.4.78, 104.26.5.78, 172.67.68.253, 2606:4700:20::681a:44e, 2606:4700:20::681a:54e, 2606:4700:20::ac43:44fd
Redirect IPs 104.20.51.207, 104.20.52.207
Response IP 104.20.52.207
Found Yes
Hash 5fcf8905d5ccdc2dcfce38d2ea262916512ca2751e348f48d197ddc541f4431d
SimHash 44185c75cd92

Groups

*

Rule Path
Disallow /bin/
Disallow /lbin/
Disallow /postavke/
Disallow /rubrika/sandbox/
Disallow /sandbox/

Other Records

Field Value
sitemap https://gol.dnevnik.hr/services/sitemaps/news
sitemap https://gol.dnevnik.hr/services/sitemaps/video
sitemap https://gol.dnevnik.hr/services/sitemaps/archive