rugvista.no
robots.txt
Robots Exclusion Standard data for rugvista.no
Resource Scan
Scan Details
Site Domain | rugvista.no |
Base Domain | rugvista.no |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-30T02:33:20+00:00 |
Next Scan | 2024-11-29T02:33:20+00:00 |
Last Successful Scan
Scanned | 2024-08-17T00:57:52+00:00 |
URL | https://rugvista.no/robots.txt |
Redirect | https://www.rugvista.no:443/robots.txt |
Redirect Domain | www.rugvista.no |
Redirect Base | rugvista.no |
Domain IPs | 52.214.193.189, 52.30.117.183, 52.30.251.228 |
Redirect IPs | 13.227.254.125, 13.227.254.24, 13.227.254.25, 13.227.254.61, 2600:9000:200a:2200:13:528e:bf00:93a1, 2600:9000:200a:6600:13:528e:bf00:93a1, 2600:9000:200a:7600:13:528e:bf00:93a1, 2600:9000:200a:7e00:13:528e:bf00:93a1, 2600:9000:200a:800:13:528e:bf00:93a1, 2600:9000:200a:8800:13:528e:bf00:93a1, 2600:9000:200a:9400:13:528e:bf00:93a1, 2600:9000:200a:9e00:13:528e:bf00:93a1 |
Response IP | 13.227.254.125 |
Found | Yes |
Hash | c42203a86164e9cf47f596b170c39fb28e1d66664c4089571cfa5acc1e994350 |
SimHash | 4a1ec942aff1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /*?*page=1& |
Allow | /*?*page=1$ |
Disallow | /login* |
Disallow | /orders* |
Disallow | /checkout/2* |
Disallow | /checkout/3* |
Disallow | /checkout/4* |
Disallow | /checkout/5* |
Disallow | /*?*length= |
Disallow | /*?*width= |
Disallow | /*?*price= |
Disallow | /*?*discount= |
Disallow | /*?*page= |
Disallow | /*?*sort= |
Disallow | /*?*utm_ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rugvista.no/sitemap.xml |