rugvista.cz
robots.txt

Robots Exclusion Standard data for rugvista.cz

Resource Scan

Scan Details

Site Domain rugvista.cz
Base Domain rugvista.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-23T04:17:15+00:00
Next Scan 2024-10-07T04:17:15+00:00

Last Successful Scan

Scanned2024-08-16T03:39:40+00:00
URL https://rugvista.cz/robots.txt
Redirect https://www.rugvista.cz:443/robots.txt
Redirect Domain www.rugvista.cz
Redirect Base rugvista.cz
Domain IPs 108.128.7.248, 52.214.193.189, 52.30.117.183
Redirect IPs 13.227.254.125, 13.227.254.24, 13.227.254.25, 13.227.254.61, 2600:9000:200a:3400:13:528e:bf00:93a1, 2600:9000:200a:3800:13:528e:bf00:93a1, 2600:9000:200a:4400:13:528e:bf00:93a1, 2600:9000:200a:5a00:13:528e:bf00:93a1, 2600:9000:200a:7800:13:528e:bf00:93a1, 2600:9000:200a:9000:13:528e:bf00:93a1, 2600:9000:200a:9400:13:528e:bf00:93a1, 2600:9000:200a:c800:13:528e:bf00:93a1
Response IP 13.227.254.24
Found Yes
Hash 2826dd5d19b3c9d05d0b747667f92b6f2811bf8dfe406161c425c6c619a99d27
SimHash 4a5ec840af71

Groups

*

Rule Path
Allow /
Allow /*?*page=1&
Allow /*?*page=1$
Disallow /login*
Disallow /orders*
Disallow /checkout/2*
Disallow /checkout/3*
Disallow /checkout/4*
Disallow /checkout/5*
Disallow /*?*length=
Disallow /*?*width=
Disallow /*?*price=
Disallow /*?*discount=
Disallow /*?*page=
Disallow /*?*sort=
Disallow /*?*utm_

ccbot
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rugvista.cz/sitemap.xml