oeteljee.nl
robots.txt
Robots Exclusion Standard data for oeteljee.nl
Resource Scan
Scan Details
| Site Domain | oeteljee.nl |
| Base Domain | oeteljee.nl |
| Scan Status | Ok |
| Last Scan | 2025-12-20T19:32:18+00:00 |
| Next Scan | 2026-01-19T19:32:18+00:00 |
Last Scan
| Scanned | 2025-12-20T19:32:18+00:00 |
| URL | https://oeteljee.nl/robots.txt |
| Redirect | https://www.oeteljee.nl/robots.txt |
| Redirect Domain | www.oeteljee.nl |
| Redirect Base | oeteljee.nl |
| Domain IPs | 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405 |
| Redirect IPs | 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405 |
| Response IP | 104.26.13.97 |
| Found | Yes |
| Hash | 6b57891e97440caf63a87d2b12abb54645f7827ccc2196fa5ff5594e9e34b85f |
| SimHash | 411fc7719c99 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cart/ |
| Disallow | /checkout/ |
| Disallow | /customer/* |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oeteljee.nl/rss/ |