competency.ai
robots.txt
Robots Exclusion Standard data for competency.ai
Resource Scan
Scan Details
| Site Domain | competency.ai |
| Base Domain | competency.ai |
| Scan Status | Ok |
| Last Scan | 2026-02-25T06:02:46+00:00 |
| Next Scan | 2026-03-27T06:02:46+00:00 |
Last Scan
| Scanned | 2026-02-25T06:02:46+00:00 |
| URL | https://competency.ai/robots.txt |
| Domain IPs | 52.22.171.164 |
| Response IP | 52.22.171.164 |
| Found | Yes |
| Hash | a8d7762f9515be588a16a79b6ab74c287bc6257cc3bceb118f00cfb433812547 |
| SimHash | 5900ce30af92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /dot/ |
| Disallow | /.well-known/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.competency.ai/sitemap.xml |