Log In Sign Up

blog.dnevnik.hr
robots.txt

Robots Exclusion Standard data for blog.dnevnik.hr

Resource Scan

Scan Details

Site Domain blog.dnevnik.hr
Base Domain dnevnik.hr
Scan Status Ok
Last Scan2024-09-07T14:13:36+00:00
Next Scan 2024-10-07T14:13:36+00:00

Last Scan

Scanned2024-09-07T14:13:36+00:00
URL https://blog.dnevnik.hr/robots.txt
Domain IPs 104.20.51.207, 104.20.52.207
Response IP 104.20.52.207
Found Yes
Hash fde37ae93db7291588f10152d42ef5802f5c7d7137876a68d753a6ee36610bac
SimHash 421ed422628a

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top