hugo.fyi
robots.txt

Robots Exclusion Standard data for hugo.fyi

Resource Scan

Scan Details

Site Domain hugo.fyi
Base Domain hugo.fyi
Scan Status Ok
Last Scan2025-10-28T09:25:54+00:00
Next Scan 2025-11-27T09:25:54+00:00

Last Scan

Scanned2025-10-28T09:25:54+00:00
URL https://hugo.fyi/robots.txt
Domain IPs 104.21.6.197, 172.67.135.58, 2606:4700:3030::ac43:873a, 2606:4700:3032::6815:6c5
Response IP 104.21.6.197
Found Yes
Hash d61f1669bfbd65e5956a65f3ed4a885d6cea99f77e41eff8487bab3fcb062bb4
SimHash 0514c1569be1

Groups

*

Rule Path
Disallow /craft/

Comments

  • Don't allow web crawlers to index Craft CMS