simon-davies.name
robots.txt

Robots Exclusion Standard data for simon-davies.name

Resource Scan

Scan Details

Site Domain simon-davies.name
Base Domain simon-davies.name
Scan Status Ok
Last Scan2025-04-27T19:08:30+00:00
Next Scan 2025-05-27T19:08:30+00:00

Last Scan

Scanned2025-04-27T19:08:30+00:00
URL https://simon-davies.name/robots.txt
Domain IPs 104.21.96.51, 172.67.173.70, 2606:4700:3033::ac43:ad46, 2606:4700:3037::6815:6033
Response IP 104.21.96.51
Found Yes
Hash d61f1669bfbd65e5956a65f3ed4a885d6cea99f77e41eff8487bab3fcb062bb4
SimHash 0514c1569be1

Groups

*

Rule Path
Disallow /craft/

Comments

  • Don't allow web crawlers to index Craft CMS