hrt.hr
robots.txt

Robots Exclusion Standard data for hrt.hr

Resource Scan

Scan Details

Site Domain hrt.hr
Base Domain hrt.hr
Scan Status Ok
Last Scan2024-11-18T03:25:50+00:00
Next Scan 2024-11-25T03:25:50+00:00

Last Scan

Scanned2024-11-18T03:25:50+00:00
URL https://www.hrt.hr/robots.txt
Domain IPs 213.5.56.43
Response IP 213.5.56.43
Found Yes
Hash 5873cf1343c2b774e162c54e4d7b2c44c90ece8db8c1d5745ff272e5044d187e
SimHash 882ce83089f2

Groups

*

Rule Path
Disallow /_next/

magpie-crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /