Log In Sign Up

nutstop.com
robots.txt

Robots Exclusion Standard data for nutstop.com

Resource Scan

Scan Details

Site Domain nutstop.com
Base Domain nutstop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-18T04:54:15+00:00
Next Scan 2026-01-16T04:54:15+00:00

Last Successful Scan

Scanned2024-06-02T16:55:49+00:00
URL https://www.nutstop.com/robots.txt
Domain IPs 104.21.6.57, 172.67.154.247, 2606:4700:3031::ac43:9af7, 2606:4700:3036::6815:639
Response IP 104.21.6.57
Found Yes
Hash 8583fc7415f929a66b6b416ec7ec2bbe5ab1883ad9be88a2cf53e937322b7ada
SimHash ab005ed5db97

Groups

*

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /wp-admin/ -
Disallow /archive -
Disallow /tag -
Disallow /author/ -
Disallow /trackback/ -
Disallow /*?* -
Disallow /*? -
Disallow /?s= -
Disallow *?replytocom -
Disallow /wp-* -
Disallow /comments/feed/ -
Disallow /wp/ -
Disallow /xmlrpc.php -
Disallow /wp-login.php -
Disallow /wp-register.php -
Disallow /recipes/cgi-bin/ -
Disallow /recipes/wp-admin/ -
Disallow /recipes/archive -
Disallow /recipes/tag -
Disallow /recipes/author/ -
Disallow /recipes/trackback/ -
Disallow /recipes/*?* -
Disallow /recipes/*? -
Disallow /recipes/?s= -
Disallow /recipes/wp-* -
Disallow /recipes/comments/feed/ -
Disallow /recipes/wp/ -
Disallow /recipes/xmlrpc.php -
Disallow /recipes/wp-login.php -
Disallow /recipes/wp-register.php -
Disallow /recipes/category/food-type/ -
Disallow /recipes/recipe-search/ *
Disallow /recipes/page/ -
Disallow /recipes/page/* -
Disallow /recipes/course/ -
Disallow /recipes/course/* -
Disallow /recipes/ingredient/ -
Disallow /recipes/ingredient/* -
Disallow /product-category/imported/waffles/ -
Disallow /product-category/imported/marmelade/ -
Disallow /product-category/imported/marshmallow/ -
Disallow /product-category/imported/candies-boxed/ -
Disallow /product-category/imported/chocolates/ -
Disallow /product-category/imported/halva-kozinak-sherbet-pastila/ -
Disallow /product-category/imported/honey-preserves/ -
Disallow /product-category/imported/gingerbread-cripsbread-sushka/ -
Disallow /product-category/imported/cookies/ -
Allow /wp-content/plugins/*.css$ -
Allow /wp-content/*.css$ -
Allow /wp-includes/*.css$ -
Allow /wp-content/plugins/*.js$ -
Allow /wp-content/plugins/*.min.js$ -
Allow /wp-content/*.js$ -
Allow /wp-includes/*.js$ -
Allow /wp-content/*.min.js$ -
Allow /wp-content/plugins/*.ttf$ -
Allow /wp-content/plugins/*.ttf?*$ -
Allow /wp-content/*.ttf$ -
Allow /wp-content/plugins/*.woff?*$ -
Allow /wp-content/plugins/*.woff$ -
Allow /wp-content/*.woff$ -
Allow /wp-content/plugins/*.svg$ -
Allow /wp-content/plugins/*.svg?*$ -
Allow /wp-content/*.svg$ -
Allow /wp-content/plugins/*.png$ -
Allow /wp-content/plugins/*.gif$ -
Allow /wp-content/*.png$ -
Allow /wp-content/uploads/*.png$ -
Allow /wp-content/uploads/*.jpg$ -
Allow /wp-content/*.png$ -
Allow /wp-content/*.jpg$ -
Allow /wp/wp-content/*.png$ -
Allow /wp/wp-content/*.jpg$ -
Allow /wp-*.css$ -
Allow /wp-*.js$ -
Allow /wp-*.min.js$ -
Allow /wp-*.ttf$ -
Allow /wp-*.woff$ -
Allow /wp-*.svg$ -
Allow /wp-*.png$ -
Allow /wp-*.jpg$ -
Allow /wp-content/plugins/yith-woocommerce-zoom-magnifier/assets/css/ -
Allow /recipes/wp-content/plugins/*.css$ -
Allow /recipes/wp-content/*.css$ -
Allow /recipes/wp-includes/*.css$ -
Allow /recipes/wp-content/plugins/*.js$ -
Allow /recipes/wp-content/plugins/*.min.js$ -
Allow /recipes/wp-content/*.js$ -
Allow /recipes/wp-includes/*.js$ -
Allow /recipes/wp-content/*.min.js$ -
Allow /recipes/wp-content/plugins/*.ttf$ -
Allow /recipes/wp-content/plugins/*.ttf?*$ -
Allow /recipes/wp-content/*.ttf$ -
Allow /recipes/wp-content/plugins/*.woff?*$ -
Allow /recipes/wp-content/plugins/*.woff$ -
Allow /recipes/wp-content/*.woff$ -
Allow /recipes/wp-content/plugins/*.svg$ -
Allow /recipes/wp-content/plugins/*.svg?*$ -
Allow /recipes/wp-content/*.svg$ -
Allow /recipes/wp-content/plugins/*.png$ -
Allow /recipes/wp-content/plugins/*.gif$ -
Allow /recipes/wp-content/*.png$ -
Allow /recipes/wp-content/uploads/*.png$ -
Allow /recipes/wp-content/uploads/*.jpg$ -
Allow /recipes/wp-content/*.png$ -
Allow /recipes/wp-content/*.jpg$ -
Allow /recipes/wp/wp-content/*.png$ -
Allow /recipes/wp/wp-content/*.jpg$ -
Allow /recipes/wp-*.css$ -
Allow /recipes/wp-*.js$ -
Allow /recipes/wp-*.min.js$ -
Allow /recipes/wp-*.ttf$ -
Allow /recipes/wp-*.woff$ -
Allow /recipes/wp-*.svg$ -
Allow /recipes/wp-*.png$ -
Allow /recipes/wp-*.jpg$ -

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

googlebot-mobile

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.nutstop.com/sitemap.xml
Back to top

Comments

  • disallow all files in these directories
Back to top

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
Back to top