smartcat.com
robots.txt
Robots Exclusion Standard data for smartcat.com
Resource Scan
Scan Details
| Site Domain | smartcat.com |
| Base Domain | smartcat.com |
| Scan Status | Ok |
| Last Scan | 2024-06-12T19:26:22+00:00 |
| Next Scan | 2024-07-12T19:26:22+00:00 |
Last Scan
| Scanned | 2024-06-12T19:26:22+00:00 |
| URL | https://smartcat.com/robots.txt |
| Redirect | https://www.smartcat.com/robots.txt |
| Redirect Domain | www.smartcat.com |
| Redirect Base | smartcat.com |
| Domain IPs | 3.248.126.43, 3.248.66.210, 54.228.92.161 |
| Redirect IPs | 13.227.254.129, 13.227.254.42, 13.227.254.82, 13.227.254.98, 2600:9000:200a:3c00:e:fdf4:5d80:93a1, 2600:9000:200a:400:e:fdf4:5d80:93a1, 2600:9000:200a:600:e:fdf4:5d80:93a1, 2600:9000:200a:6e00:e:fdf4:5d80:93a1, 2600:9000:200a:9a00:e:fdf4:5d80:93a1, 2600:9000:200a:a600:e:fdf4:5d80:93a1, 2600:9000:200a:b600:e:fdf4:5d80:93a1, 2600:9000:200a:c000:e:fdf4:5d80:93a1 |
| Response IP | 13.227.254.42 |
| Found | Yes |
| Hash | 40f90cad93648e598b9dbc780dfa4c708bc3e95554a2c090dec833916cb1c4f5 |
| SimHash | 4c0d5c408190 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
*
| Rule | Path |
|---|---|
| Disallow | /lp/ |
*
| Rule | Path |
|---|---|
| Disallow | /c/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.smartcat.com/sitemap.xml |