bogoon.com
robots.txt
Robots Exclusion Standard data for bogoon.com
Resource Scan
Scan Details
Site Domain | bogoon.com |
Base Domain | bogoon.com |
Scan Status | Ok |
Last Scan | 2024-11-13T17:05:17+00:00 |
Next Scan | 2024-11-20T17:05:17+00:00 |
Last Scan
Scanned | 2024-11-13T17:05:17+00:00 |
URL | https://bogoon.com/robots.txt |
Domain IPs | 104.21.66.190, 172.67.163.120, 2606:4700:3035::6815:42be, 2606:4700:3035::ac43:a378 |
Response IP | 104.21.66.190 |
Found | Yes |
Hash | 12589c24bdb27159bd74295511a9e1d752a72d1f2814ffeb6c361da9b5917d5d |
SimHash | 880759d9e382 |
Groups
*
Rule | Path |
---|---|
Disallow | /control/ |
Disallow | /config/ |
Disallow | /cron/ |
Disallow | /view/ |
Disallow | /install/ |
Disallow | /lib/ |
Disallow | /editor/ |
Disallow | /model/ |
Disallow | /js/ |
Disallow | /style/ |
Disallow | /data/ |
Disallow | /lang/ |
Disallow | /ajax/ |
Disallow | /wiki/ |
Disallow | /user/ |
Comments