rugvista.se
robots.txt
Robots Exclusion Standard data for rugvista.se
Resource Scan
Scan Details
| Site Domain | rugvista.se |
| Base Domain | rugvista.se |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-25T12:20:33+00:00 |
| Next Scan | 2024-10-09T12:20:33+00:00 |
Last Successful Scan
| Scanned | 2024-08-18T11:07:51+00:00 |
| URL | https://rugvista.se/robots.txt |
| Redirect | https://www.rugvista.se:443/robots.txt |
| Redirect Domain | www.rugvista.se |
| Redirect Base | rugvista.se |
| Domain IPs | 52.30.117.183, 52.30.251.228, 54.228.141.78 |
| Redirect IPs | 13.227.254.125, 13.227.254.24, 13.227.254.25, 13.227.254.61, 2600:9000:200a:2400:13:528e:bf00:93a1, 2600:9000:200a:2c00:13:528e:bf00:93a1, 2600:9000:200a:5a00:13:528e:bf00:93a1, 2600:9000:200a:6000:13:528e:bf00:93a1, 2600:9000:200a:7c00:13:528e:bf00:93a1, 2600:9000:200a:c600:13:528e:bf00:93a1, 2600:9000:200a:de00:13:528e:bf00:93a1, 2600:9000:200a:fc00:13:528e:bf00:93a1 |
| Response IP | 13.227.254.24 |
| Found | Yes |
| Hash | 916c1569366eebcbdf5a55da27f1a91f75f44f04ce79219032bc5450f07348a5 |
| SimHash | 4a5ec140afb1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*?*page=1& |
| Allow | /*?*page=1$ |
| Disallow | /login* |
| Disallow | /orders* |
| Disallow | /checkout/2* |
| Disallow | /checkout/3* |
| Disallow | /checkout/4* |
| Disallow | /checkout/5* |
| Disallow | /*?*length= |
| Disallow | /*?*width= |
| Disallow | /*?*price= |
| Disallow | /*?*discount= |
| Disallow | /*?*page= |
| Disallow | /*?*sort= |
| Disallow | /*?*utm_ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rugvista.se/sitemap.xml |