competera.ai
robots.txt
Robots Exclusion Standard data for competera.ai
Resource Scan
Scan Details
| Site Domain | competera.ai |
| Base Domain | competera.ai |
| Scan Status | Ok |
| Last Scan | 2025-08-19T20:15:37+00:00 |
| Next Scan | 2025-09-18T20:15:37+00:00 |
Last Scan
| Scanned | 2025-08-19T20:15:37+00:00 |
| URL | https://competera.ai/robots.txt |
| Domain IPs | 104.21.11.226, 172.67.192.221, 2606:4700:3033::6815:be2, 2606:4700:3034::ac43:c0dd |
| Response IP | 172.67.192.221 |
| Found | Yes |
| Hash | 001f21743888b24d5331f1ca9f6ebda797152e1545fd89945db40aa3584471ee |
| SimHash | 35e6f1232a52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /homepage |
| Disallow | /test-stylesheet |
| Disallow | /trial_activation |
| Disallow | /sign-up-BI-eng |
| Disallow | /sign-up-PI-ru |
| Disallow | /pricing-page |
| Disallow | /free-trial-PI-eng |
| Disallow | /sign-up-PI-eng |
| Disallow | /free-trial-PI-ru |
| Disallow | /sign-up-BI-ru |
| Disallow | /competera-christmas |
| Disallow | /test-stylesheet |
| Disallow | /website-map |
| Disallow | /cd-uk |
| Disallow | /cd-us |
| Disallow | /cd-apac |
| Disallow | /landing-po-uk |
| Disallow | /pdf/case_study_intertop_linked_en_v2.pdf |
| Disallow | /pricing-old |
| Disallow | /brand-campaign |
| Disallow | /solutions/landing-page |
| Disallow | /retail-pricing-software |
| Disallow | /en/software-privacy-policy |
| Disallow | /ua/software-privacy-policy |
| Disallow | *__hsfp%3D* |
| Disallow | *__hssc%3D* |
| Disallow | *__hstc%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://competera.ai/sitemap.xml |