bruneau.fr
robots.txt
Robots Exclusion Standard data for bruneau.fr
Resource Scan
Scan Details
Site Domain | bruneau.fr |
Base Domain | bruneau.fr |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-03-18T21:43:45+00:00 |
Next Scan | 2024-06-16T21:43:45+00:00 |
Last Successful Scan
Scanned | 2023-04-28T03:23:54+00:00 |
URL | https://bruneau.fr/robots.txt |
Redirect | https://www.bruneau.fr/robots.txt |
Redirect Domain | www.bruneau.fr |
Redirect Base | bruneau.fr |
Domain IPs | 13.107.246.67 |
Redirect IPs | 13.107.237.59, 13.107.238.59, 2620:1ec:4e:1::59, 2620:1ec:4f:1::59 |
Response IP | 13.107.238.59 |
Found | Yes |
Hash | 4f5221d2312b8a8c5c363d76f07b7ecad2fcfdc763aa316adc0db87df6cc9daf |
SimHash | e29f53c247e3 |
Groups
*
Rule | Path |
---|---|
Disallow | *?filters=* |
Disallow | *%26filters%3D* |
Disallow | *?sort=* |
Disallow | *%26sort%3D* |
Disallow | *%26shelf%3D* |
Disallow | *?shelf=* |
Disallow | *%26min-price%3D* |
Disallow | *?max-price=* |
Disallow | *?min-price=* |
Disallow | *%26max-price%3D* |
Disallow | /account |
Disallow | /captcha |
Disallow | /cart |
Disallow | /search |
Disallow | /fastorder |
Disallow | /sav |
Disallow | /myaccount |
Disallow | /purchase |
Disallow | /error |
Disallow | /configurateurstore.htm |
Disallow | /content/noindex |
Disallow | /login |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Comments