rws.com
robots.txt
Robots Exclusion Standard data for rws.com
Resource Scan
Scan Details
| Site Domain | rws.com |
| Base Domain | rws.com |
| Scan Status | Ok |
| Last Scan | 2024-08-29T14:02:18+00:00 |
| Next Scan | 2024-09-28T14:02:18+00:00 |
Last Scan
| Scanned | 2024-08-29T14:02:18+00:00 |
| URL | https://rws.com/robots.txt |
| Redirect | https://www.rws.com:443/robots.txt |
| Redirect Domain | www.rws.com |
| Redirect Base | rws.com |
| Domain IPs | 104.26.14.182, 104.26.15.182, 172.67.74.40, 2606:4700:20::681a:eb6, 2606:4700:20::681a:fb6, 2606:4700:20::ac43:4a28 |
| Redirect IPs | 2600:9000:2721:200:14:cb62:3100:93a1, 2600:9000:2721:3200:14:cb62:3100:93a1, 2600:9000:2721:5000:14:cb62:3100:93a1, 2600:9000:2721:5800:14:cb62:3100:93a1, 2600:9000:2721:e000:14:cb62:3100:93a1, 2600:9000:2721:e00:14:cb62:3100:93a1, 2600:9000:2721:e600:14:cb62:3100:93a1, 2600:9000:2721:fe00:14:cb62:3100:93a1, 3.165.102.128, 3.165.102.14, 3.165.102.33, 3.165.102.62 |
| Response IP | 3.165.102.33 |
| Found | Yes |
| Hash | 390f18445aae5c3b3f1aaf8214e7f0da52929a17c39ac8f41ab59b415a73309e |
| SimHash | 2834d014c7f1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /system/* |
| Disallow | /de/system/* |
| Disallow | /fr/system/* |
| Disallow | /jp/system/* |
| Disallow | /it/system/* |
| Disallow | /es/system/* |
| Disallow | /cn/system/* |
| Disallow | /kr/system/* |
| Disallow | /test/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rws.com/sitemap.xml |