ai.ceo
robots.txt
Robots Exclusion Standard data for ai.ceo
Resource Scan
Scan Details
Site Domain | ai.ceo |
Base Domain | ai.ceo |
Scan Status | Ok |
Last Scan | 2025-04-16T17:00:26+00:00 |
Next Scan | 2025-05-16T17:00:26+00:00 |
Last Scan
Scanned | 2025-04-16T17:00:26+00:00 |
URL | https://ai.ceo/robots.txt |
Domain IPs | 104.21.80.89, 172.67.176.161, 2606:4700:3030::6815:5059, 2606:4700:3037::ac43:b0a1 |
Response IP | 172.67.176.161 |
Found | Yes |
Hash | dd5c8a313055e391b1f325c1ec4474d7450b680cf4a97bc46746486fa3aaa2ee |
SimHash | 452ce64d67d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets |
Disallow | /cache |
Disallow | /sources |
Disallow | /api |
Disallow | /script_backups |
Disallow | /updates |
Disallow | /install |
Disallow | /admincp |
Disallow | /admin-panel |