knify.gg
robots.txt

Robots Exclusion Standard data for knify.gg

Resource Scan

Scan Details

Site Domain knify.gg
Base Domain knify.gg
Scan Status Ok
Last Scan2024-10-23T09:39:01+00:00
Next Scan 2024-11-22T09:39:01+00:00

Last Scan

Scanned2024-10-23T09:39:01+00:00
URL https://knify.gg/robots.txt
Domain IPs 104.19.154.92
Response IP 104.19.154.92
Found Yes
Hash 7a255b9d10a0c2125b036667b1bc79a41fb072245cbcc9efee840223b05a652f
SimHash 279389027eb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow */medias/wpforms/
Disallow */login
Disallow */test
Disallow */feed
Disallow */trackback
Disallow */wp-login
Disallow /*.gz
Disallow /*.cgi
Disallow *?wpgb-ajax=*
Disallow *?blocksy-header-id=*
Disallow *?add-to-cart=*
Disallow *?loginSocial*
Disallow *?orderby=*
Disallow *?filter_*
Disallow *?attribute_*
Disallow *?remove_item=*
Disallow *?utm_*
Disallow *?gclid*
Disallow *?fbclid=*
Disallow */wp-json/pmw/v1/products/*
Disallow *?action=wpm*
Disallow *?s=*
Disallow *?aff=*
Disallow *?currency=*

neevabot
blexbot
mozilla/5.0 (compatible; optimizer)
yandex
yandexbot
snapbot
bidswitchbot
discobot
alittle client
pixalate
pixalate.com
petalbot
tpradstxtcrawler
barkrowler
bidswitchbot/1.0
mozilla/5.0 (compatible; barkrowler/0.9; +https://babbar.tech/crawler)
duckduckbot
tpradstxtcrawler/1.0

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot
bingbot
mozilla/5.0 (compatible; qwantify/; +https://www.qwant.com/)
mozilla/5.0 (compatible; bingbot/2.0; +https://www.bing.com/bingbot.htm)
adsbot-google
googlebot-image

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://knify.gg/sitemap_index.xml

Comments

  • PAGES
  • EXTENSIONS
  • QUERY PARAMETERS DISALLOW
  • AGENTS
  • SEO Tools & Service - Set Crawl Delay for Optimal Performance
  • SITEMAPS