khafan69.com
robots.txt

Robots Exclusion Standard data for khafan69.com

Resource Scan

Scan Details

Site Domain khafan69.com
Base Domain khafan69.com
Scan Status Ok
Last Scan2025-03-19T04:38:42+00:00
Next Scan 2025-04-18T04:38:42+00:00

Last Scan

Scanned2025-03-19T04:38:42+00:00
URL https://khafan69.com/robots.txt
Redirect https://jendekhune.com/robots.txt
Redirect Domain jendekhune.com
Redirect Base jendekhune.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.90.117, 172.67.200.102, 2606:4700:3034::ac43:c866, 2606:4700:3036::6815:5a75
Response IP 104.21.90.117
Found Yes
Hash 001b5143682d12da8200e6b567858a80f60e04a312cf0fa43c5bc553bc292950
SimHash 6a375c6226f2

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /cgi-bin/ -
Disallow /trackback/ -
Disallow /brand/index?brand_id= -
Disallow /a2f6product/product_id%3D -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /list/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /?s= Blocks internal search URLs
Disallow /*?p= Blocks raw post IDs
Disallow /*?q= Blocks spammy search URLs
Disallow /*?kg= Blocks spam query strings
Disallow /*?wd= Blocks common Chinese search queries
Disallow /*?search= Blocks any search query URL
Disallow /*?page_id= Blocks direct page ID URLs
Disallow /*?ref= Blocks spam referral tracking
Allow /wp-admin/admin-ajax.php -

googlebot
bingbot
slurp
duckduckgo
baiduspider

Rule Path
Allow /

sogou
etaospider
sosospider
easouspider
mj12bot

Rule Path
Disallow /

ahrefsbot
semrushbot
dotbot
blexbot
httrack
yisouspider
yandeximages

Rule Path
Disallow /

Comments

  • Allow all major search engines
  • Block Chinese search engine spam bots
  • Block bad SEO bots & scrapers

Warnings

  • 1 invalid line.