xrite.com
robots.txt
Robots Exclusion Standard data for xrite.com
Resource Scan
Scan Details
| Site Domain | xrite.com |
| Base Domain | xrite.com |
| Scan Status | Ok |
| Last Scan | 2024-05-01T02:26:35+00:00 |
| Next Scan | 2024-05-31T02:26:35+00:00 |
Last Scan
| Scanned | 2024-05-01T02:26:35+00:00 |
| URL | https://xrite.com/robots.txt |
| Redirect | https://www.xrite.com/robots.txt |
| Redirect Domain | www.xrite.com |
| Redirect Base | xrite.com |
| Domain IPs | 75.2.9.209, 99.83.199.29 |
| Redirect IPs | 13.35.18.61, 13.35.18.66, 13.35.18.80, 13.35.18.91, 2600:9000:20c7:1200:5:2433:6400:93a1, 2600:9000:20c7:1a00:5:2433:6400:93a1, 2600:9000:20c7:7400:5:2433:6400:93a1, 2600:9000:20c7:9400:5:2433:6400:93a1, 2600:9000:20c7:9c00:5:2433:6400:93a1, 2600:9000:20c7:a600:5:2433:6400:93a1, 2600:9000:20c7:b200:5:2433:6400:93a1, 2600:9000:20c7:cc00:5:2433:6400:93a1 |
| Response IP | 13.35.18.61 |
| Found | Yes |
| Hash | 4bbbf957d48d323a06679c3201eafaabcfec7fa086add28b0f538a243db51857 |
| SimHash | 121d80c04c33 |
Groups
ahrefsbot
ahrefsbot/4.0
backlinkcrawler
gsitecrawler
ip-web-crawler.com
ips-agent
linkdex
linkdex.com
linkdex.com/v2.0
linkdex.com/v2.1
rogerbot
mj12bot
semrushbot
spyfu
xenu
xenu link sleuth
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | Lang%3D* |
| Disallow | /verify.aspx?v=* |
| Disallow | /translate |
| Disallow | /search?search=* |
| Disallow | /registration.aspx |
| Disallow | /*/data/products-root/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.xrite.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments