boottotaal.be
robots.txt

Robots Exclusion Standard data for boottotaal.be

Resource Scan

Scan Details

Site Domain boottotaal.be
Base Domain boottotaal.be
Scan Status Ok
Last Scan2025-11-20T12:15:12+00:00
Next Scan 2025-12-20T12:15:12+00:00

Last Scan

Scanned2025-11-20T12:15:12+00:00
URL https://boottotaal.be/robots.txt
Redirect https://www.boottotaal.be/robots.txt
Redirect Domain www.boottotaal.be
Redirect Base boottotaal.be
Domain IPs 104.16.8.49, 104.17.156.30
Redirect IPs 104.16.8.49, 104.17.156.30, 2606:4700::6810:831, 2606:4700::6811:9c1e
Response IP 104.17.156.30
Found Yes
Hash 3d81c7d433b5b96e17096d6ddd4fd76cafc3bb2a74bee081d51dcce356241a99
SimHash 85295c76cb57

Groups

*

Rule Path
Disallow /admin
Disallow /account/
Disallow /cart/
Disallow /compare/
Disallow /checkout/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.boottotaal.be/sitemap.xml