gourmetsupremacy.com
robots.txt

Robots Exclusion Standard data for gourmetsupremacy.com

Resource Scan

Scan Details

Site Domain gourmetsupremacy.com
Base Domain gourmetsupremacy.com
Scan Status Ok
Last Scan2024-09-22T06:38:22+00:00
Next Scan 2024-09-29T06:38:22+00:00

Last Scan

Scanned2024-09-22T06:38:22+00:00
URL https://gourmetsupremacy.com/robots.txt
Domain IPs 104.21.51.169, 172.67.183.1, 2606:4700:3032::6815:33a9, 2606:4700:3035::ac43:b701
Response IP 172.67.183.1
Found Yes
Hash 4e3e1a97c7c2d77ee96b1170ddbeb0f4dcb92781d3a2dc92b730e99ad1d50d63
SimHash dcfa695ba69a

Groups

acapbot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

attackbot

Rule Path
Disallow /

backdorbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

binlar

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bunnys

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

casper

Rule Path
Disallow /

checkpriv

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypick

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

choppy

Rule Path
Disallow /

clshttp

Rule Path
Disallow /

cmsworld

Rule Path
Disallow /

copernic

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crescent

Rule Path
Disallow /

cy_cho

Rule Path
Disallow /

datacha

Rule Path
Disallow /

demon

Rule Path
Disallow /

diavol

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotnetdotcom

Rule Path
Disallow /

dumbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extract

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

feedfinder

Rule Path
Disallow /

flaming

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path Comment
Disallow /path/to/private-content/ -
Disallow /admin/ -
Disallow /login/ -
Disallow /cgi-bin/ -
Disallow /wp-admin/ -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /wp-content/plugins/ -
Disallow /wp-content/themes/ -
Disallow /wp-includes/ -
Disallow /trackback/ -
Disallow /comments/ -
Disallow /feed/ -
Disallow /tag/ -
Disallow /category/ -
Disallow /author/ -
Disallow /page/ -
Disallow /?s= -
Disallow /search/ -
Disallow /archives/ -
Disallow /tag/ -
Disallow /comment/ -
Disallow /reply/ -
Disallow /json/ -
Disallow /rss/ -
Disallow /atom/ -
Disallow /?feed= -
Disallow /?feed=rss -
Disallow /?feed=rss2 -
Disallow /?feed=rdf -
Disallow /?feed=atom -
Disallow /*?*replytocom=* -
Disallow /*?*reply-to=* -
Disallow /*?*replycontent=* -
Disallow /*?*reply_id=* -
Disallow /*?*reply_comment_id=* -
Disallow /*?add-to-cart=* -
Disallow /?wc-ajax=* -
Disallow /*add-to-cart%3D* -
Disallow /*orderby%3D* -
Disallow /*?orderby=* -
Disallow /*order%3D* -
Disallow /*?order=* -
Disallow /*?sort_by=* -
Disallow /*?rating=* -
Disallow /*?rating_filter=* -
Disallow /*?rating_filter=* -
Disallow /*?filter_* -
Disallow /*?min_price=* -
Disallow /*?max_price=* -
Disallow /*?quantity=* -
Disallow /*?ajax_filter=* -
Disallow /*?yith-* -
Disallow /*?product_cat=* -
Disallow /*?product_tag=* -
Disallow /*?display=* -
Disallow /*?pagination=* -
Disallow /*?add-to-wishlist=* -
Disallow /*?add-to-cart=* -
Disallow /*?remove_item=* -
Disallow /*?variation_id=* -
Disallow /*?attribute_* -
Disallow /*?attribute_pa_* -
Disallow /*?quick_view=* -
Disallow /*?mail= -
Disallow /*?email=* -
Disallow /*?_pjax= -
Disallow /*?_escaped_fragment_=* -
Disallow /path/to/images/ Disallow all images directories

Warnings

  • 2 invalid lines.