ivet.hu
robots.txt

Robots Exclusion Standard data for ivet.hu

Resource Scan

Scan Details

Site Domain ivet.hu
Base Domain ivet.hu
Scan Status Ok
Last Scan2026-01-17T02:09:13+00:00
Next Scan 2026-02-16T02:09:13+00:00

Last Scan

Scanned2026-01-17T02:09:13+00:00
URL https://ivet.hu/robots.txt
Redirect https://www.ivet.hu/robots.txt
Redirect Domain www.ivet.hu
Redirect Base ivet.hu
Domain IPs 104.26.0.248, 104.26.1.248, 172.67.74.153, 2606:4700:20::681a:1f8, 2606:4700:20::681a:f8, 2606:4700:20::ac43:4a99
Redirect IPs 104.26.0.248, 104.26.1.248, 172.67.74.153, 2606:4700:20::681a:1f8, 2606:4700:20::681a:f8, 2606:4700:20::ac43:4a99
Response IP 104.26.0.248
Found Yes
Hash 7c17c4c8c3f3a01d366be008b52f857533af67795136d461ab433beded3e273d
SimHash 4e80ddd2a361

Groups

*

Rule Path
Disallow /user/*
Disallow /cart*
Disallow /*/cart*
Disallow /login*
Disallow /*/login*
Disallow /forgot_pass*
Disallow /*/forgot_pass*
Disallow /register*
Disallow /*/register*
Disallow /profile*
Disallow /*/profile*
Disallow /addresses*
Disallow /*/addresses*
Disallow /orders*
Disallow /*/orders*
Disallow /wishlist*
Disallow /*/wishlist*
Disallow /checkout*
Disallow /checkout_final*
Disallow /compare/*
Disallow /thank-you$
Disallow /userfiles/editor/*
Allow /*/product/*
Allow /*/category/*
Allow /product/*
Allow /category/*
Allow /*/userfiles/productlargeimages/*
Allow /*/userfiles/productthumbs/*
Allow /userfiles/productlargeimages/*
Allow /userfiles/productthumbs/*
Disallow /cdn-cgi/

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.ivet.hu/sitemap.xml

Warnings

  • 2 invalid lines.