ivet.bg
robots.txt

Robots Exclusion Standard data for ivet.bg

Resource Scan

Scan Details

Site Domain ivet.bg
Base Domain ivet.bg
Scan Status Ok
Last Scan2026-01-13T18:35:46+00:00
Next Scan 2026-02-12T18:35:46+00:00

Last Scan

Scanned2026-01-13T18:35:46+00:00
URL https://ivet.bg/robots.txt
Redirect https://www.ivet.bg/robots.txt
Redirect Domain www.ivet.bg
Redirect Base ivet.bg
Domain IPs 104.26.6.39, 104.26.7.39, 172.67.71.185, 2606:4700:20::681a:627, 2606:4700:20::681a:727, 2606:4700:20::ac43:47b9
Redirect IPs 104.26.6.39, 104.26.7.39, 172.67.71.185, 2606:4700:20::681a:627, 2606:4700:20::681a:727, 2606:4700:20::ac43:47b9
Response IP 104.26.6.39
Found Yes
Hash a3cec32ddef32d88f5eedff4bcfd54ec83d890d1ae4ea49d09aaebf31c878bd4
SimHash 4e80d9d2a261

Groups

*

Rule Path
Disallow /user/*
Disallow /cart*
Disallow /*/cart*
Disallow /login*
Disallow /*/login*
Disallow /forgot_pass*
Disallow /*/forgot_pass*
Disallow /register*
Disallow /*/register*
Disallow /profile*
Disallow /*/profile*
Disallow /addresses*
Disallow /*/addresses*
Disallow /orders*
Disallow /*/orders*
Disallow /wishlist*
Disallow /*/wishlist*
Disallow /checkout*
Disallow /checkout_final*
Disallow /compare/*
Disallow /thank-you$
Disallow /userfiles/editor/*
Allow /*/product/*
Allow /*/category/*
Allow /product/*
Allow /category/*
Allow /*/userfiles/productlargeimages/*
Allow /*/userfiles/productthumbs/*
Allow /userfiles/productlargeimages/*
Allow /userfiles/productthumbs/*
Disallow /cdn-cgi/

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.ivet.bg/sitemap.xml

Warnings

  • 2 invalid lines.