octavian.net
robots.txt

Robots Exclusion Standard data for octavian.net

Resource Scan

Scan Details

Site Domain octavian.net
Base Domain octavian.net
Scan Status Ok
Last Scan2025-12-16T11:09:26+00:00
Next Scan 2025-12-23T11:09:26+00:00

Last Scan

Scanned2025-12-16T11:09:26+00:00
URL http://octavian.net/robots.txt
Redirect https://hkmdb.com/robots.txt
Redirect Domain hkmdb.com
Redirect Base hkmdb.com
Domain IPs 44.230.47.103
Redirect IPs 44.230.47.103
Response IP 44.230.47.103
Found Yes
Hash 49c979ee0f6500e67eeeb853b241b240a4c2413529a3d698d3293d1f2c3b6433
SimHash 9565d770b602

Groups

amazonbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

tiktokspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

terracotta

Rule Path
Disallow /

Warnings

  • `meta-externalagent` is not a known field.