brico.fr
robots.txt
Robots Exclusion Standard data for brico.fr
Resource Scan
Scan Details
| Site Domain | brico.fr |
| Base Domain | brico.fr |
| Scan Status | Ok |
| Last Scan | 2024-11-13T06:09:35+00:00 |
| Next Scan | 2024-11-20T06:09:35+00:00 |
Last Scan
| Scanned | 2024-11-13T06:09:35+00:00 |
| URL | https://brico.fr/robots.txt |
| Redirect | https://www.brico.fr/robots.txt |
| Redirect Domain | www.brico.fr |
| Redirect Base | brico.fr |
| Domain IPs | 141.94.143.229, 2001:41d0:403:4ee5:: |
| Redirect IPs | 141.94.143.229 |
| Response IP | 141.94.143.229 |
| Found | Yes |
| Hash | 9b0cf9092b52cebb5986e9fea10a7ab7c336c0f290891e965b0f3f0fc18c6575 |
| SimHash | 233f44502bb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /panier |
| Disallow | /confirmation |
| Disallow | /goto/ |
gomezagent
gomezagent
gomezagent+1.0
gomezagent+1.0
gomezagent+2.0
gomezagent+2.0
gomezagent+3.0
gomezagent+3.0
gomezagent 1.0
gomezagent 2.0
gomezagent 3.0
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
fasterfox
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
shopwiki
snapbot
turnitinbot
twiceler
twengabot
woozweb-monitoring
woriobot
yacybot
yacybit
yandexbot
yandex
yeti
yodaobot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.brico.fr/sitemap.xml |
Comments