brabantsepostzegelveiling.nl
robots.txt
Robots Exclusion Standard data for brabantsepostzegelveiling.nl
Resource Scan
Scan Details
Site Domain | brabantsepostzegelveiling.nl |
Base Domain | brabantsepostzegelveiling.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-10T23:37:15+00:00 |
Next Scan | 2024-10-24T23:37:15+00:00 |
Last Successful Scan
Scanned | 2024-09-02T23:09:37+00:00 |
URL | https://www.brabantsepostzegelveiling.nl/robots.txt |
Domain IPs | 217.21.240.133 |
Response IP | 217.21.240.133 |
Found | Yes |
Hash | 9f43d992cfd251c4cc3bcf70e94482e809fd877c39fe74784a9856d96133c505 |
SimHash | d008c0c0df5a |
Groups
*
Rule | Path |
---|---|
Disallow | /lib/* |
Disallow | /now/* |
Disallow | /goto/* |
Disallow | /error/* |
Disallow | /feeds/* |
Disallow | /admin/* |
Disallow | /accounts/* |
Disallow | /shop/cart/* |
Disallow | /shop/ship/* |
Disallow | /omnikassa/* |
Disallow | /shop/checkout/* |
Disallow | /online-auction/favorite/* |
Disallow | /online-auction/bid/place/ |
Disallow | /online-auction/bid/check/ |
Disallow | /online-auction/bid/disable_robot/ |