bistronhome.fr
robots.txt

Robots Exclusion Standard data for bistronhome.fr

Resource Scan

Scan Details

Site Domain bistronhome.fr
Base Domain bistronhome.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-22T08:07:48+00:00
Next Scan 2024-10-20T08:07:48+00:00

Last Successful Scan

Scanned2023-06-05T12:07:03+00:00
URL https://bistronhome.fr/robots.txt
Redirect https://www.bistronhome.fr/robots.txt
Redirect Domain www.bistronhome.fr
Redirect Base bistronhome.fr
Domain IPs 163.172.90.178, 2001:bc8:2a7a:100::1
Redirect IPs 163.172.90.178, 2001:bc8:2a7a:100::1
Response IP 163.172.90.178
Found Yes
Hash e9d54379e33b41dc426f167d89c8de64cb9dc62b575536e5a20da003d6ca80fa
SimHash 1b0164738a33

Groups

woozweb-monitoring

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

urlpouls

Rule Path
Disallow /

estimurl

Rule Path
Disallow /

bizinformation

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

urlespion

Rule Path
Disallow /

urlmetriques

Rule Path
Disallow /

cubestat

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bistronhome.fr/sitemap-index.xml

Warnings

  • `host` is not a known field.