oralb.fr
robots.txt
Robots Exclusion Standard data for oralb.fr
Resource Scan
Scan Details
| Site Domain | oralb.fr |
| Base Domain | oralb.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-09T08:18:06+00:00 |
| Next Scan | 2024-12-08T08:18:06+00:00 |
Last Successful Scan
| Scanned | 2024-05-06T07:14:18+00:00 |
| URL | https://oralb.fr/robots.txt |
| Redirect | https://www.oralb.fr/robots.txt |
| Redirect Domain | www.oralb.fr |
| Redirect Base | oralb.fr |
| Domain IPs | 20.72.101.229 |
| Redirect IPs | 18.155.68.119, 18.155.68.124, 18.155.68.57, 18.155.68.6, 2600:9000:23d2:1600:17:cc86:5000:93a1, 2600:9000:23d2:1a00:17:cc86:5000:93a1, 2600:9000:23d2:3e00:17:cc86:5000:93a1, 2600:9000:23d2:5800:17:cc86:5000:93a1, 2600:9000:23d2:8400:17:cc86:5000:93a1, 2600:9000:23d2:a000:17:cc86:5000:93a1, 2600:9000:23d2:c800:17:cc86:5000:93a1, 2600:9000:23d2:e00:17:cc86:5000:93a1 |
| Response IP | 18.155.68.119 |
| Found | Yes |
| Hash | 82dff58f44ce45adb0c5274b1ed14cbe54462e666e313085d45c6acd56ccc208 |
| SimHash | 7d3500042092 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /geoip$ |
| Disallow | /customer$ |
| Disallow | /profiling/ |
| Disallow | /optins |
| Disallow | /badges |
| Disallow | /user/me$ |
| Disallow | /me$ |
| Disallow | /orders$ |
| Disallow | /*data/ |
| Disallow | /*payment/ |
| Disallow | /*product-popup/ |
| Disallow | /debug |
| Disallow | /index.php |
| Disallow | /*wholesale/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oralb.fr/sitemap.xml |