oralb.es
robots.txt
Robots Exclusion Standard data for oralb.es
Resource Scan
Scan Details
| Site Domain | oralb.es |
| Base Domain | oralb.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-28T21:07:22+00:00 |
| Next Scan | 2024-06-11T21:07:22+00:00 |
Last Successful Scan
| Scanned | 2024-05-06T18:08:56+00:00 |
| URL | https://oralb.es/robots.txt |
| Redirect | https://www.oralb.es/robots.txt |
| Redirect Domain | www.oralb.es |
| Redirect Base | oralb.es |
| Domain IPs | 20.72.101.229 |
| Redirect IPs | 13.33.88.20, 13.33.88.25, 13.33.88.55, 13.33.88.81, 2600:9000:223b:4600:0:3937:1540:93a1, 2600:9000:223b:7800:0:3937:1540:93a1, 2600:9000:223b:800:0:3937:1540:93a1, 2600:9000:223b:9800:0:3937:1540:93a1, 2600:9000:223b:a00:0:3937:1540:93a1, 2600:9000:223b:a200:0:3937:1540:93a1, 2600:9000:223b:cc00:0:3937:1540:93a1, 2600:9000:223b:f200:0:3937:1540:93a1 |
| Response IP | 13.33.88.20 |
| Found | Yes |
| Hash | e879e499802e8b8c4d93bbbfd4f7d27fefbf0dbe903813ef91050e6c20aff218 |
| SimHash | 5d3500046016 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /geoip$ |
| Disallow | /customer$ |
| Disallow | /profiling/ |
| Disallow | /optins |
| Disallow | /badges |
| Disallow | /user/me$ |
| Disallow | /me$ |
| Disallow | /orders$ |
| Disallow | /*data/ |
| Disallow | /*payment/ |
| Disallow | /*product-popup/ |
| Disallow | /debug |
| Disallow | /index.php |
| Disallow | /*wholesale/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oralb.es/sitemap.xml |