herbal.rs
robots.txt

Robots Exclusion Standard data for herbal.rs

Resource Scan

Scan Details

Site Domain herbal.rs
Base Domain herbal.rs
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-11T04:17:49+00:00
Next Scan 2025-12-10T04:17:49+00:00

Last Successful Scan

Scanned2023-02-23T12:45:05+00:00
URL https://herbal.rs/robots.txt
Redirect https://www.herbal.rs/robots.txt
Redirect Domain www.herbal.rs
Redirect Base herbal.rs
Domain IPs 176.104.107.66
Redirect IPs 176.104.107.66
Response IP 176.104.107.66
Found Yes
Hash be2b542ccf646de11442c425d124a9170cabcac8e8fa6a64799b9f9e559a1f72
SimHash 6a52ad68c7f4

Groups

*

Rule Path
Allow /catalog/*.js
Allow /catalog/*.css
Disallow /*%26limit
Disallow /*?limit
Disallow /*?sort
Disallow /*%26sort
Disallow /*?order
Disallow /*%26order
Disallow /*?price
Disallow /*%26price
Disallow /*?brand_tabletpc
Disallow /*%26brand_tabletpc
Disallow /*?color_default
Disallow /*%26color_default
Disallow /*?filter_tag
Disallow /*%26filter_tag
Disallow /*?mode
Disallow /*%26mode
Disallow /*?cat
Disallow /*%26cat
Disallow /*?dir
Disallow /*%26dir
Disallow /*?color
Disallow /*%26color
Disallow /*?product_id
Disallow /*%26product_id
Disallow /*?minprice
Disallow /*%26minprice
Disallow /*?maxprice
Disallow /*%26maxprice
Disallow /*?route=checkout%2F
Disallow /*?route=tmdqc%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2Fsearch
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /?route=information%2Fcontact
Disallow /*?route=affiliate%2F
Disallow /*?keyword
Disallow /*?av
Disallow /admin/
Disallow /system/
Disallow /catalog/

Other Records

Field Value
sitemap https://www.herbal.rs/index.php?route=extension/feed/google_sitemap