kpn-wholesale.com
robots.txt
Robots Exclusion Standard data for kpn-wholesale.com
Resource Scan
Scan Details
Site Domain | kpn-wholesale.com |
Base Domain | kpn-wholesale.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-28T04:30:14+00:00 |
Next Scan | 2024-06-11T04:30:14+00:00 |
Last Successful Scan
Scanned | 2024-04-20T01:03:01+00:00 |
URL | https://kpn-wholesale.com/robots.txt |
Redirect | https://www.kpn-wholesale.com:443/robots.txt |
Redirect Domain | www.kpn-wholesale.com |
Redirect Base | kpn-wholesale.com |
Domain IPs | 2600:9000:a400:dede:1a1c:a23f:9ae6:7bbc, 2600:9000:a504:9080:40c0:d138:ca59:2e3d, 75.2.72.204, 99.83.136.155 |
Redirect IPs | 13.33.88.120, 13.33.88.19, 13.33.88.57, 13.33.88.59, 2600:9000:223b:7800:11:a4e9:a580:93a1, 2600:9000:223b:7e00:11:a4e9:a580:93a1, 2600:9000:223b:9800:11:a4e9:a580:93a1, 2600:9000:223b:a00:11:a4e9:a580:93a1, 2600:9000:223b:a800:11:a4e9:a580:93a1, 2600:9000:223b:aa00:11:a4e9:a580:93a1, 2600:9000:223b:ec00:11:a4e9:a580:93a1, 2600:9000:223b:fa00:11:a4e9:a580:93a1 |
Response IP | 13.33.88.120 |
Found | Yes |
Hash | 1daf733fdf67128982ccf8b4d87975c577d07adc50410147bacc342258cbe1af |
SimHash | 084c9042c27b |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /web |
Disallow | /w3/file* |
Disallow | /systeem/* |
Disallow | /testpages/* |
Disallow | /zoekresultaten.htm |
Disallow | /search-results.htm |
Other Records
Field | Value |
---|---|
sitemap | https://www.kpn-wholesale.com/sitemap_index.xml |