jotex.nl
robots.txt
Robots Exclusion Standard data for jotex.nl
Resource Scan
Scan Details
| Site Domain | jotex.nl |
| Base Domain | jotex.nl |
| Scan Status | Ok |
| Last Scan | 2024-05-27T16:07:20+00:00 |
| Next Scan | 2024-06-26T16:07:20+00:00 |
Last Scan
| Scanned | 2024-05-27T16:07:20+00:00 |
| URL | https://jotex.nl/robots.txt |
| Redirect | https://www.jotex.nl/robots.txt |
| Redirect Domain | www.jotex.nl |
| Redirect Base | jotex.nl |
| Domain IPs | 91.208.174.76 |
| Redirect IPs | 18.164.154.14, 18.164.154.2, 18.164.154.28, 18.164.154.96, 2600:9000:2503:1800:13:78ca:8780:93a1, 2600:9000:2503:2600:13:78ca:8780:93a1, 2600:9000:2503:7a00:13:78ca:8780:93a1, 2600:9000:2503:8600:13:78ca:8780:93a1, 2600:9000:2503:9c00:13:78ca:8780:93a1, 2600:9000:2503:b400:13:78ca:8780:93a1, 2600:9000:2503:d600:13:78ca:8780:93a1, 2600:9000:2503:f800:13:78ca:8780:93a1 |
| Response IP | 108.157.52.55 |
| Found | Yes |
| Hash | 632c7b1355d040e93913a56d7d7566d79c0cd412a1206114ddf6c2f7089725f8 |
| SimHash | c012cbcf5312 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /INTERSHOP/ |
| Disallow | *?write-review |
| Disallow | /search/ |
| Disallow | /brand/-/ |
| Disallow | /deals/ |
| Disallow | /search? |
| Disallow | *?filter |
| Allow | /INTERSHOP/static/WFS/*/*/*/*/css/ |
| Allow | /INTERSHOP/static/WFS/*/*/*/*/js/adobe/ |
| Allow | /INTERSHOP/static/WFS/*/*/*/*/js/vendor/ |
| Allow | /INTERSHOP/static/WFS/*/*/*/*/minifiedJs/ |