hrt.hr
robots.txt

Robots Exclusion Standard data for hrt.hr

Resource Scan

Scan Details

Site Domain hrt.hr
Base Domain hrt.hr
Scan Status Ok
Last Scan2024-09-22T18:25:10+00:00
Next Scan 2024-09-29T18:25:10+00:00

Last Scan

Scanned2024-09-22T18:25:10+00:00
URL https://www.hrt.hr/robots.txt
Domain IPs 213.5.56.43
Response IP 213.5.56.43
Found Yes
Hash 5873cf1343c2b774e162c54e4d7b2c44c90ece8db8c1d5745ff272e5044d187e
SimHash 882ce83089f2

Groups

*

Rule Path
Disallow /_next/

magpie-crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /