vanderveldeboeken.nl
robots.txt
Robots Exclusion Standard data for vanderveldeboeken.nl
Resource Scan
Scan Details
| Site Domain | vanderveldeboeken.nl |
| Base Domain | vanderveldeboeken.nl |
| Scan Status | Ok |
| Last Scan | 2024-10-27T22:46:51+00:00 |
| Next Scan | 2024-11-26T22:46:51+00:00 |
Last Scan
| Scanned | 2024-10-27T22:46:51+00:00 |
| URL | https://vanderveldeboeken.nl/robots.txt |
| Redirect | https://www.vanderveldeboeken.nl/robots.txt |
| Redirect Domain | www.vanderveldeboeken.nl |
| Redirect Base | vanderveldeboeken.nl |
| Domain IPs | 104.26.2.97, 104.26.3.97, 172.67.70.130, 2606:4700:20::681a:261, 2606:4700:20::681a:361, 2606:4700:20::ac43:4682 |
| Redirect IPs | 104.26.2.97, 104.26.3.97, 172.67.70.130, 2606:4700:20::681a:261, 2606:4700:20::681a:361, 2606:4700:20::ac43:4682 |
| Response IP | 172.67.70.130 |
| Found | Yes |
| Hash | c0401d9943ddf6f8092e01920d8131e59b51f06378e13f0d12f13220b6fa0da1 |
| SimHash | 7d7099c109b7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Static |
| Disallow | /*/Static |
| Disallow | /static |
| Disallow | /*/static |
| Disallow | /Error |
| Disallow | /*/Error |
| Disallow | /umbraco |
| Disallow | /*/umbraco |
| Disallow | /umbraco_client |
| Disallow | /*/umbraco_client |
| Disallow | |
| Disallow | |
| Disallow | /media |
| Disallow | /*/media |
| Disallow | /StudyBooks |
| Disallow | /*/StudyBooks |
| Disallow | /winkelmandje/ |
| Disallow | /*/winkelmandje/ |
| Disallow | /winkelwagen/ |
| Disallow | /*/winkelwagen/ |
| Disallow | /afrekenen/ |
| Disallow | /*/afrekenen/ |
| Disallow | /inloggen/ |
| Disallow | /*/inloggen/ |
| Disallow | /*/*?SearchText=* |
| Disallow | /*/?q=* |
| Disallow | /*/?a=* |
| Disallow | /ShoppingCart/ |
| Disallow | /*/ShoppingCart/ |
| Disallow | /Checkout/ |
| Disallow | /*/Checkout/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |