bibi.cl
robots.txt

Robots Exclusion Standard data for bibi.cl

Resource Scan

Scan Details

Site Domain bibi.cl
Base Domain bibi.cl
Scan Status Ok
Last Scan2024-09-07T01:18:03+00:00
Next Scan 2024-10-07T01:18:03+00:00

Last Scan

Scanned2024-09-07T01:18:03+00:00
URL https://www.bibi.cl/robots.txt
Domain IPs 13.35.18.112, 13.35.18.120, 13.35.18.23, 13.35.18.83, 2600:9000:20c7:2600:4:e2f9:6580:93a1, 2600:9000:20c7:4600:4:e2f9:6580:93a1, 2600:9000:20c7:7a00:4:e2f9:6580:93a1, 2600:9000:20c7:8800:4:e2f9:6580:93a1, 2600:9000:20c7:9000:4:e2f9:6580:93a1, 2600:9000:20c7:c800:4:e2f9:6580:93a1, 2600:9000:20c7:da00:4:e2f9:6580:93a1, 2600:9000:20c7:e600:4:e2f9:6580:93a1
Response IP 13.35.18.112
Found Yes
Hash 6a94e05db42726fd2ffb11dd65cbc25a90a1ee26f97dc9ff4a01bd24ac34adbd
SimHash f638cd964dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow *buscavazia*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.bibi.cl/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.