shop.oralb.it
robots.txt
Robots Exclusion Standard data for shop.oralb.it
Resource Scan
Scan Details
| Site Domain | shop.oralb.it |
| Base Domain | oralb.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-06T16:49:00+00:00 |
| Next Scan | 2024-12-05T16:49:00+00:00 |
Last Successful Scan
| Scanned | 2024-05-03T16:03:49+00:00 |
| URL | https://shop.oralb.it/robots.txt |
| Domain IPs | 108.156.133.50, 108.156.133.53, 108.156.133.71, 108.156.133.98, 2600:9000:2755:4000:13:9697:1240:93a1, 2600:9000:2755:4e00:13:9697:1240:93a1, 2600:9000:2755:7200:13:9697:1240:93a1, 2600:9000:2755:8000:13:9697:1240:93a1, 2600:9000:2755:9800:13:9697:1240:93a1, 2600:9000:2755:bc00:13:9697:1240:93a1, 2600:9000:2755:c400:13:9697:1240:93a1, 2600:9000:2755:da00:13:9697:1240:93a1 |
| Response IP | 108.156.133.98 |
| Found | Yes |
| Hash | 1b5229bc0b7e92f00f56423b548188594da3f46ba215003e42526193a0c97e27 |
| SimHash | 1d35200c6016 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /geoip$ |
| Disallow | /customer$ |
| Disallow | /profiling/ |
| Disallow | /optins |
| Disallow | /badges |
| Disallow | /user/me$ |
| Disallow | /me$ |
| Disallow | /orders$ |
| Disallow | /*data/ |
| Disallow | /*payment/ |
| Disallow | /*product-popup/ |
| Disallow | /debug |
| Disallow | /index.php |
| Disallow | /*wholesale/ |