freeward.net
robots.txt

Robots Exclusion Standard data for freeward.net

Resource Scan

Scan Details

Site Domain freeward.net
Base Domain freeward.net
Scan Status Ok
Last Scan2026-01-27T12:08:19+00:00
Next Scan 2026-02-10T12:08:19+00:00

Last Scan

Scanned2026-01-27T12:08:19+00:00
URL https://freeward.net/robots.txt
Domain IPs 104.26.8.91, 104.26.9.91, 172.67.74.213, 2606:4700:20::681a:85b, 2606:4700:20::681a:95b, 2606:4700:20::ac43:4ad5
Response IP 104.26.8.91
Found Yes
Hash b2661fbe4e80e84354169a4245ffc5e40df99fa65cfca64325eaffdb7fc79698
SimHash 6d2b4226e26e

Groups

*

Rule Path
Allow /
Disallow /login
Disallow /register
Disallow /password/reset
Disallow /auth
Disallow /*/auth
Disallow /*auth%3A
Disallow /dashboard/
Disallow /ref/
Disallow /*/ref/
Disallow /*?ref=
Disallow /*%26ref%3D
Disallow /api/
Disallow /private/
Disallow /server/
Disallow /middleware/
Disallow /feed
Disallow /fontawesome
Disallow /*/fontawesome
Allow /_next/image/

Other Records

Field Value
sitemap https://freeward.net/sitemap.xml

Comments

  • ------------------------------------
  • 1. Critical Security & Auth Blocks
  • ------------------------------------
  • Blocks leaked session URLs like /ko/auth:...
  • ------------------------------------
  • 2. Functional & Dashboard Pages
  • ------------------------------------
  • ------------------------------------
  • 3. Referral Spam & Parameters
  • ------------------------------------
  • ------------------------------------
  • 4. System, API & Assets
  • ------------------------------------
  • ------------------------------------
  • 5. Allow Necessary Assets
  • ------------------------------------
  • ------------------------------------
  • 6. Sitemap
  • ------------------------------------