wolfgourmet.com
robots.txt

Robots Exclusion Standard data for wolfgourmet.com

Resource Scan

Scan Details

Site Domain wolfgourmet.com
Base Domain wolfgourmet.com
Scan Status Ok
Last Scan2024-09-20T03:29:13+00:00
Next Scan 2024-10-20T03:29:13+00:00

Last Scan

Scanned2024-09-20T03:29:13+00:00
URL https://wolfgourmet.com/robots.txt
Domain IPs 192.124.249.62
Response IP 192.124.249.62
Found Yes
Hash 28e1b8996a815099a442e7f834d7de2fd971bf6e3c351d41b2eca5c6645abd8d
SimHash 0d0cef077692

Groups

storebot-google

Rule Path
Disallow /ast
Disallow /confirmation
Disallow /search-results?
Disallow /*/search-results?
Disallow /store/cookware/11-inch-skillet
Disallow /store/cookware/3-quart-saute-pan-with-lid
Disallow /store/cookware/6-quart-deep-saute-pan-with-lid
Disallow /store/cookware/6-quart-dutch-oven-with-lid
Disallow /store/cutlery/6-inch-santoku-knife
Disallow /store/cutlery/7-piece-cutlery-set
Disallow /store/cutlery/8-inch-chef-knife
Disallow /store/parts-and-accessories/10inch-tri-ply-baking-sheet
Disallow /store/parts-and-accessories/64oz-blender-jar-990190120
Disallow /store/parts-and-accessories/7-quart-mixing-bowl
Disallow /store/parts-and-accessories/coffee-system-thermal-carafe-990299400
Disallow /store/parts-and-accessories/coffee-system-water-filter-holder-990299900
Disallow /store/parts-and-accessories/cookware-large-lid-990200700
Disallow /store/parts-and-accessories/countertop-oven-broil-rack-990193230
Disallow /store/parts-and-accessories/high-performance-blender-knob-red-990190140
Disallow /store/parts-and-accessories/multi-function-cooker-knob-red-990296300
Allow /*.js
Allow /*.css
Allow /*.gif
Allow /*.jpeg
Allow /*.jpg
Allow /*.png
Allow /*.svg
Allow /*.woff2

*

Rule Path
Disallow /ast
Disallow /confirmation
Disallow /search-results?
Disallow /*/search-results?
Allow /*utm_campaign%3Dgoogle_search_box

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://wolfgourmet.com/sitemap.xml

Comments

  • Site: wolfgourmet.com/robots.txt
  • Readme: developers.google.com/search/docs/advanced/crawling/overview-google-crawlers