rugvista.com
robots.txt

Robots Exclusion Standard data for rugvista.com

Resource Scan

Scan Details

Site Domain rugvista.com
Base Domain rugvista.com
Scan Status Ok
Last Scan2024-06-15T07:45:04+00:00
Next Scan 2024-07-15T07:45:04+00:00

Last Scan

Scanned2024-06-15T07:45:04+00:00
URL https://rugvista.com/robots.txt
Redirect https://www.rugvista.com:443/robots.txt
Redirect Domain www.rugvista.com
Redirect Base rugvista.com
Domain IPs 54.217.222.11, 54.217.227.240, 99.81.120.156
Redirect IPs 13.227.254.125, 13.227.254.24, 13.227.254.25, 13.227.254.61, 2600:9000:200a:0:13:528e:bf00:93a1, 2600:9000:200a:1800:13:528e:bf00:93a1, 2600:9000:200a:3800:13:528e:bf00:93a1, 2600:9000:200a:6c00:13:528e:bf00:93a1, 2600:9000:200a:ae00:13:528e:bf00:93a1, 2600:9000:200a:bc00:13:528e:bf00:93a1, 2600:9000:200a:d000:13:528e:bf00:93a1, 2600:9000:200a:d800:13:528e:bf00:93a1
Response IP 13.227.254.125
Found Yes
Hash 90147e00ae9935c1211c140a052311772a14b52db3bd7018aba021a1f2b40f49
SimHash 4a1ec1422f33

Groups

*

Rule Path
Allow /
Allow /*?*page=1&
Allow /*?*page=1$
Disallow /login*
Disallow /orders*
Disallow /checkout/2*
Disallow /checkout/3*
Disallow /checkout/4*
Disallow /checkout/5*
Disallow /*?*length=
Disallow /*?*width=
Disallow /*?*price=
Disallow /*?*discount=
Disallow /*?*page=
Disallow /*?*sort=

ccbot
ahrefsbot
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rugvista.com/sitemap.xml