knivesandtools.nl
robots.txt
Robots Exclusion Standard data for knivesandtools.nl
Resource Scan
Scan Details
| Site Domain | knivesandtools.nl |
| Base Domain | knivesandtools.nl |
| Scan Status | Ok |
| Last Scan | 2024-05-01T15:41:53+00:00 |
| Next Scan | 2024-05-31T15:41:53+00:00 |
Last Scan
| Scanned | 2024-05-01T15:41:53+00:00 |
| URL | https://knivesandtools.nl/robots.txt |
| Redirect | https://www.knivesandtools.nl/robots.txt |
| Redirect Domain | www.knivesandtools.nl |
| Redirect Base | knivesandtools.nl |
| Domain IPs | 104.26.8.108, 104.26.9.108, 172.67.69.147, 2606:4700:20::681a:86c, 2606:4700:20::681a:96c, 2606:4700:20::ac43:4593 |
| Redirect IPs | 104.26.8.108, 104.26.9.108, 172.67.69.147, 2606:4700:20::681a:86c, 2606:4700:20::681a:96c, 2606:4700:20::ac43:4593 |
| Response IP | 104.26.8.108 |
| Found | Yes |
| Hash | 47988fbd734bb7cbd4db3a739e690af7a0592af4dc885201a12c281267fbda7d |
| SimHash | eb151476cb33 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /account |
| Disallow | /*/compare |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.knivesandtools.nl/sitemap.xml |
| sitemap | https://www.knivesandtools.nl/sitemap/products.xml |
| sitemap | https://www.knivesandtools.nl/sitemap/categories.xml |
| sitemap | https://www.knivesandtools.nl/sitemap/content.xml |
| sitemap | https://www.knivesandtools.nl/sitemap/articles.xml |