Log In Sign Up

fupai.net
robots.txt

Robots Exclusion Standard data for fupai.net

Resource Scan

Scan Details

Site Domain fupai.net
Base Domain fupai.net
Scan Status Ok
Last Scan2026-03-01T08:44:39+00:00
Next Scan 2026-03-08T08:44:39+00:00

Last Scan

Scanned2026-03-01T08:44:39+00:00
URL https://fupai.net/robots.txt
Domain IPs 104.21.37.143, 172.67.209.43, 2606:4700:3031::6815:258f, 2606:4700:3032::ac43:d12b
Response IP 172.67.209.43
Found Yes
Hash dbde945d77e6540477940ae0c160f8052c22a7ae16f6449344baa624ac56229b
SimHash 6811ca12c615

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /auth/
Allow /favicon.svg
Allow /sitemap.xml

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://fupai.net/sitemap.xml
Back to top

Comments

  • Disallow admin and API routes
  • Disallow authentication routes
  • Allow all static assets
  • Sitemap location
  • Crawl delay (optional, helps prevent server overload)
Back to top