techniektotaal.com
robots.txt

Robots Exclusion Standard data for techniektotaal.com

Resource Scan

Scan Details

Site Domain techniektotaal.com
Base Domain techniektotaal.com
Scan Status Ok
Last Scan2025-12-03T06:25:18+00:00
Next Scan 2026-01-02T06:25:18+00:00

Last Scan

Scanned2025-12-03T06:25:18+00:00
URL https://techniektotaal.com/robots.txt
Redirect https://www.techniektotaal.com/robots.txt
Redirect Domain www.techniektotaal.com
Redirect Base techniektotaal.com
Domain IPs 104.16.8.49, 104.17.156.30
Redirect IPs 104.16.8.49, 104.17.156.30, 2606:4700::6810:831, 2606:4700::6811:9c1e
Response IP 104.17.156.30
Found Yes
Hash c0ab2d1ffe4e7368ac2331f0bcee4f2a0fe0b26b6291164407b5ffc995368846
SimHash a174dc2eabd7

Groups

*

Rule Path
Disallow /admin
Disallow /nl/account/
Disallow /de/account/
Disallow /en/account/
Disallow /nl/cart/
Disallow /de/cart/
Disallow /en/cart/
Disallow /nl/compare/
Disallow /de/compare/
Disallow /en/compare/
Disallow /nl/checkout/
Disallow /de/checkout/
Disallow /en/checkout/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.techniektotaal.com/sitemap.xml