theexpert.com
robots.txt
Robots Exclusion Standard data for theexpert.com
Resource Scan
Scan Details
| Site Domain | theexpert.com |
| Base Domain | theexpert.com |
| Scan Status | Ok |
| Last Scan | 2025-09-27T21:06:30+00:00 |
| Next Scan | 2025-10-27T21:06:30+00:00 |
Last Scan
| Scanned | 2025-09-27T21:06:30+00:00 |
| URL | https://theexpert.com/robots.txt |
| Redirect | https://www.theexpert.com/robots.txt |
| Redirect Domain | www.theexpert.com |
| Redirect Base | theexpert.com |
| Domain IPs | 216.150.1.193 |
| Redirect IPs | 216.150.1.65, 216.150.16.65 |
| Response IP | 216.150.16.193 |
| Found | Yes |
| Hash | e4bf76f565820bd0e6721fd8dcbd4719dbb6bb4ab1379614e5155ea5064d53b6 |
| SimHash | cd31ce17f710 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /client/ |
| Disallow | /expert/ |
| Disallow | /verify-email |
| Disallow | /coupon/checkout/thank-you |
| Disallow | /purchase/checkout/thank-you |
| Disallow | /showroom/confirmation |
| Disallow | /shop/confirmation |
| Disallow | /consultation-recap |
| Disallow | /questionnaire |
| Disallow | /session-checkout |
| Disallow | /session-review |
| Disallow | /showroom/preview/ |
| Disallow | /shop/preview/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.theexpert.com/sitemap.xml |
| sitemap | https://www.theexpert.com/server-sitemap.xml |
Warnings
- `host` is not a known field.
Comments