jendekhune.com
robots.txt

Robots Exclusion Standard data for jendekhune.com

Resource Scan

Scan Details

Site Domain jendekhune.com
Base Domain jendekhune.com
Scan Status Ok
Last Scan2025-03-29T05:26:47+00:00
Next Scan 2025-04-28T05:26:47+00:00

Last Scan

Scanned2025-03-29T05:26:47+00:00
URL https://jendekhune.com/robots.txt
Domain IPs 104.21.90.117, 172.67.200.102, 2606:4700:3034::ac43:c866, 2606:4700:3036::6815:5a75
Response IP 104.21.90.117
Found Yes
Hash 001b5143682d12da8200e6b567858a80f60e04a312cf0fa43c5bc553bc292950
SimHash 6a375c6226f2

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /cgi-bin/ -
Disallow /trackback/ -
Disallow /brand/index?brand_id= -
Disallow /a2f6product/product_id%3D -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /list/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /?s= Blocks internal search URLs
Disallow /*?p= Blocks raw post IDs
Disallow /*?q= Blocks spammy search URLs
Disallow /*?kg= Blocks spam query strings
Disallow /*?wd= Blocks common Chinese search queries
Disallow /*?search= Blocks any search query URL
Disallow /*?page_id= Blocks direct page ID URLs
Disallow /*?ref= Blocks spam referral tracking
Allow /wp-admin/admin-ajax.php -

googlebot
bingbot
slurp
duckduckgo
baiduspider

Rule Path
Allow /

sogou
etaospider
sosospider
easouspider
mj12bot

Rule Path
Disallow /

ahrefsbot
semrushbot
dotbot
blexbot
httrack
yisouspider
yandeximages

Rule Path
Disallow /

Comments

  • Allow all major search engines
  • Block Chinese search engine spam bots
  • Block bad SEO bots & scrapers

Warnings

  • 1 invalid line.