duijvestein-winterstore.nl
robots.txt
Robots Exclusion Standard data for duijvestein-winterstore.nl
Resource Scan
Scan Details
| Site Domain | duijvestein-winterstore.nl |
| Base Domain | duijvestein-winterstore.nl |
| Scan Status | Ok |
| Last Scan | 2024-05-30T00:39:51+00:00 |
| Next Scan | 2024-06-29T00:39:51+00:00 |
Last Scan
| Scanned | 2024-05-30T00:39:51+00:00 |
| URL | https://duijvestein-winterstore.nl/robots.txt |
| Redirect | https://www.duijvestein-winterstore.nl/robots.txt |
| Redirect Domain | www.duijvestein-winterstore.nl |
| Redirect Base | duijvestein-winterstore.nl |
| Domain IPs | 104.26.14.79, 104.26.15.79, 172.67.74.78, 2606:4700:20::681a:e4f, 2606:4700:20::681a:f4f, 2606:4700:20::ac43:4a4e |
| Redirect IPs | 104.26.14.79, 104.26.15.79, 172.67.74.78, 2606:4700:20::681a:e4f, 2606:4700:20::681a:f4f, 2606:4700:20::ac43:4a4e |
| Response IP | 104.26.15.79 |
| Found | Yes |
| Hash | 05dc44eaa5db0ea0d57f0cecfac7d22503dfe3f7e367f57328a7657b8f3fe70a |
| SimHash | 6c0012440d4b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /checkout |
| Disallow | /account |
| Disallow | /register |
| Disallow | /account |
| Disallow | /widget |
| Disallow | /navigation |
| Disallow | /detail |
| Disallow | /cookie-consent |
| Disallow | /wishlist |
| Disallow | /product/getstock |
| Disallow | /*?order=* |
| Disallow | /*%26order%3D* |
| Disallow | /*?properties=* |
| Disallow | /*%26properties%3D* |
| Disallow | /*?p=* |
| Disallow | /*%26p%3D* |
| Disallow | /*?search=* |
| Disallow | /*%26search%3D* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.duijvestein-winterstore.nl/sitemap/salesChannel-6f76c60b06de454e968ac5fce5edeaeb-9f462ebe9d1a4fcfa38317383e7321c7/6f76c60b06de454e968ac5fce5edeaeb-sitemap-www-duijvestein-winterstore-nl-1.xml.gz |
Comments