himofei.com
robots.txt

Robots Exclusion Standard data for himofei.com

Resource Scan

Scan Details

Site Domain himofei.com
Base Domain himofei.com
Scan Status Ok
Last Scan2025-10-14T12:48:10+00:00
Next Scan 2025-10-21T12:48:10+00:00

Last Scan

Scanned2025-10-14T12:48:10+00:00
URL https://himofei.com/robots.txt
Redirect https://www.mofei.life/robots.txt
Redirect Domain www.mofei.life
Redirect Base mofei.life
Domain IPs 104.21.82.176, 172.67.161.46, 2606:4700:3031::6815:52b0, 2606:4700:3032::ac43:a12e
Redirect IPs 104.21.9.90, 172.67.159.184, 2606:4700:3030::ac43:9fb8, 2606:4700:3032::6815:95a
Response IP 104.21.9.90
Found Yes
Hash 5bbefd2f5576f1d1e76befd4ec45610b5a530bee529cf12faa005f9c366bbd96
SimHash 6310da33e6a2

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /tag/
Disallow /*?p=
Disallow /admin/
Disallow /_next/
Disallow /private/
Disallow /en/blog/draft/
Disallow /zh/blog/draft/
Allow /img/
Allow /article/
Allow /*.js
Allow /*.css

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.mofei.life/sitemap.xml
sitemap https://www.mofei.life/en/rss
sitemap https://www.mofei.life/zh/rss

Comments

  • Allow search engines to access important static files
  • Crawl delay for better server performance
  • Sitemaps