rugvista.hu
robots.txt

Robots Exclusion Standard data for rugvista.hu

Resource Scan

Scan Details

Site Domain rugvista.hu
Base Domain rugvista.hu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-25T14:48:32+00:00
Next Scan 2024-12-24T14:48:32+00:00

Last Successful Scan

Scanned2024-08-03T23:19:31+00:00
URL https://rugvista.hu/robots.txt
Redirect https://www.rugvista.hu:443/robots.txt
Redirect Domain www.rugvista.hu
Redirect Base rugvista.hu
Domain IPs 34.251.221.214, 34.255.189.160, 52.213.210.220
Redirect IPs 13.227.254.125, 13.227.254.24, 13.227.254.25, 13.227.254.61, 2600:9000:200a:0:13:528e:bf00:93a1, 2600:9000:200a:1a00:13:528e:bf00:93a1, 2600:9000:200a:1e00:13:528e:bf00:93a1, 2600:9000:200a:2c00:13:528e:bf00:93a1, 2600:9000:200a:3800:13:528e:bf00:93a1, 2600:9000:200a:6e00:13:528e:bf00:93a1, 2600:9000:200a:b400:13:528e:bf00:93a1, 2600:9000:200a:c800:13:528e:bf00:93a1
Response IP 13.227.254.61
Found Yes
Hash 3edbca74ab6ff17e8e732c8869d3d402f57e183e3127175d4c0e21ec45054723
SimHash 4b5ec1400f31

Groups

*

Rule Path
Allow /
Allow /*?*page=1&
Allow /*?*page=1$
Disallow /login*
Disallow /orders*
Disallow /checkout/2*
Disallow /checkout/3*
Disallow /checkout/4*
Disallow /checkout/5*
Disallow /*?*length=
Disallow /*?*width=
Disallow /*?*price=
Disallow /*?*discount=
Disallow /*?*page=
Disallow /*?*sort=

ccbot
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rugvista.hu/sitemap.xml