Log In Sign Up

chineseft.net
robots.txt

Robots Exclusion Standard data for chineseft.net

Resource Scan

Scan Details

Site Domain chineseft.net
Base Domain chineseft.net
Scan Status Ok
Last Scan2026-03-30T02:15:49+00:00
Next Scan 2026-04-13T02:15:49+00:00

Last Scan

Scanned2026-03-30T02:15:49+00:00
URL https://chineseft.net/robots.txt
Domain IPs 54.250.176.243
Response IP 54.250.176.243
Found Yes
Hash 894e8ae1453b4eda50e007f7d9b43e4e6837d57468526765222c889d88e331fd
SimHash 0470e68945f4

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • --- EMERGENCY MODE: BLOCK ALL BOTS TEMPORARILY ---
  • We are currently experiencing high database load.
  • This rule blocks all crawlers (Google, Bing, etc.) to save resources.
  • --- ORIGINAL SETTINGS (Uncomment below to restore) ---
  • --- Allow major search engines ---
  • User-agent: Googlebot
  • Allow: /
  • User-agent: Bingbot
  • Allow: /
  • User-agent: Baiduspider
  • Allow: /
  • --- Allow social share bots (for previews) ---
  • User-agent: LinkedInBot
  • Allow: /
  • User-agent: facebookexternalhit
  • Allow: /
  • User-agent: Twitterbot
  • Allow: /
  • (Optional) cover social bots that present as Mozilla/5.0
  • User-agent: Mozilla/5.0
  • Allow: /
  • User-agent: Slackbot-LinkExpanding
  • Allow: /
  • --- Block Perplexity explicitly ---
  • User-agent: PerplexityBot
  • Disallow: /
  • --- Block all other bots by default ---
  • (NOTE: This is commented out because the emergency rule at the top handles it)
  • User-agent: *
  • Disallow: /
Back to top