knivesandtools.be
robots.txt
Robots Exclusion Standard data for knivesandtools.be
Resource Scan
Scan Details
| Site Domain | knivesandtools.be |
| Base Domain | knivesandtools.be |
| Scan Status | Ok |
| Last Scan | 2024-05-01T22:01:19+00:00 |
| Next Scan | 2024-05-31T22:01:19+00:00 |
Last Scan
| Scanned | 2024-05-01T22:01:19+00:00 |
| URL | https://knivesandtools.be/robots.txt |
| Redirect | https://www.knivesandtools.be/robots.txt |
| Redirect Domain | www.knivesandtools.be |
| Redirect Base | knivesandtools.be |
| Domain IPs | 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e |
| Redirect IPs | 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e |
| Response IP | 104.26.9.148 |
| Found | Yes |
| Hash | 22a839964a19ab1cf10fa994e04d8bc04eb322a932ba74a41c23c85f3dfdf170 |
| SimHash | e8559806cd11 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /account |
| Disallow | /*/compare |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.knivesandtools.be/sitemap.xml |
| sitemap | https://www.knivesandtools.be/sitemap/products.xml |
| sitemap | https://www.knivesandtools.be/sitemap/categories.xml |
| sitemap | https://www.knivesandtools.be/sitemap/content.xml |
| sitemap | https://www.knivesandtools.be/sitemap/articles.xml |