bob.barcus.me
robots.txt
Robots Exclusion Standard data for bob.barcus.me
Resource Scan
Scan Details
Site Domain | bob.barcus.me |
Base Domain | barcus.me |
Scan Status | Ok |
Last Scan | 2025-06-26T09:43:19+00:00 |
Next Scan | 2025-07-26T09:43:19+00:00 |
Last Scan
Scanned | 2025-06-26T09:43:19+00:00 |
URL | https://bob.barcus.me/robots.txt |
Domain IPs | 104.21.53.113, 172.67.212.59, 2606:4700:3033::6815:3571, 2606:4700:3035::ac43:d43b |
Response IP | 104.21.53.113 |
Found | Yes |
Hash | be24df8c4462b711d9a22a354c4a9d90beb1b6ab6ac813a7231fdbbc4251fb4c |
SimHash | 8050708c69d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /blocks |
Disallow | /concrete |
Disallow | /config |
Disallow | /controllers |
Disallow | /css |
Disallow | /elements |
Disallow | /helpers |
Disallow | /jobs |
Disallow | /js |
Disallow | /languages |
Disallow | /libraries |
Disallow | |
Disallow | /models |
Disallow | /packages |
Disallow | /single_pages |
Disallow | /themes |
Disallow | /tools |
Disallow | /updates |