bartang.eu
robots.txt

Robots Exclusion Standard data for bartang.eu

Resource Scan

Scan Details

Site Domain bartang.eu
Base Domain bartang.eu
Scan Status Ok
Last Scan2025-11-01T18:28:53+00:00
Next Scan 2025-12-01T18:28:53+00:00

Last Scan

Scanned2025-11-01T18:28:53+00:00
URL https://bartang.eu/robots.txt
Redirect https://www.bartang.eu/robots.txt
Redirect Domain www.bartang.eu
Redirect Base bartang.eu
Domain IPs 104.16.8.49, 104.17.156.30
Redirect IPs 104.16.8.49, 104.17.156.30, 2606:4700::6810:831, 2606:4700::6811:9c1e
Response IP 104.16.8.49
Found Yes
Hash 899666281372c577d2095fdc853c10e9b59cdcd5d75b5a8cf1b7e7f04075f20c
SimHash 8155dc02af51

Groups

*

Rule Path
Disallow /admin
Disallow /nl/account/
Disallow /en/account/
Disallow /nl/cart/
Disallow /en/cart/
Disallow /nl/compare/
Disallow /en/compare/
Disallow /nl/checkout/
Disallow /en/checkout/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.bartang.eu/sitemap.xml