chicagoknifeworks.com
robots.txt

Robots Exclusion Standard data for chicagoknifeworks.com

Resource Scan

Scan Details

Site Domain chicagoknifeworks.com
Base Domain chicagoknifeworks.com
Scan Status Ok
Last Scan2024-05-01T13:39:56+00:00
Next Scan 2024-05-31T13:39:56+00:00

Last Scan

Scanned2024-05-01T13:39:56+00:00
URL https://www.chicagoknifeworks.com/robots.txt
Domain IPs 104.26.8.44, 104.26.9.44, 172.67.69.226, 2606:4700:20::681a:82c, 2606:4700:20::681a:92c, 2606:4700:20::ac43:45e2
Response IP 104.26.8.44
Found Yes
Hash 8accb6e1ee220b4c65c9df914e6a7886133a91fdd4fc0424fccd2a9f46e41566
SimHash eb2c5cc1e2f3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/
Allow /wp-content/cache/
Allow /wp-includes/js/
Disallow /wp-login.php
Disallow /readme.html
Disallow /refer/
Disallow /*.gz$
Disallow /*.zip$
Disallow /*.php$
Disallow /trackback/
Disallow /wp-includes/
Disallow /crons/
Disallow /crons/*
Disallow /amazon/
Disallow /amazon/*
Disallow /suppliers/
Disallow /suppliers/*
Disallow /api/
Disallow /api/*
Disallow /knives-outdoor-gear-catalogue/
Disallow /knives-outdoor-gear-catalogue/*
Disallow *?filter=*
Disallow *?product_count=*
Disallow *?product_view=*
Disallow *?product_order=*
Disallow *?filtering=*
Disallow *?product_orderby*
Disallow */order/
Disallow *?view=*
Disallow */feed/
Disallow *?s=*
Disallow */cart/
Disallow */checkout/
Disallow */my-account/
Disallow */page/
Disallow */colors/
Disallow */?orderby*
Disallow *?*
Disallow */my-wishlist/
Disallow */my-wishlist/*
Disallow *?limit=*
Disallow *?amp=*
Disallow *?mode=*
Disallow *?order=*
Disallow *?dir=*
Disallow *?color=*
Disallow *?lock_type=*
Disallow */page/*
Disallow *?fbclid=*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.chicagoknifeworks.com/sitemap_index.xml