Log In Sign Up

learnwise.ai
robots.txt

Robots Exclusion Standard data for learnwise.ai

Resource Scan

Scan Details

Site Domain learnwise.ai
Base Domain learnwise.ai
Scan Status Ok
Last Scan2025-10-27T05:26:48+00:00
Next Scan 2025-11-26T05:26:48+00:00

Last Scan

Scanned2025-10-27T05:26:48+00:00
URL https://learnwise.ai/robots.txt
Redirect https://www.learnwise.ai/robots.txt
Redirect Domain www.learnwise.ai
Redirect Base learnwise.ai
Domain IPs 198.202.211.1
Redirect IPs 104.18.40.102, 172.64.147.154, 2606:4700:4406::ac40:939a, 2a06:98c1:3107::6812:2866
Response IP 104.18.40.102
Found Yes
Hash e93b31a3db1fe5330bdfe5df709f833ab302fd0267955644ccf385b96566ab08
SimHash ad246427ed12

Groups

*

Rule Path
Disallow /api/
Disallow /admin/
Disallow /internal/
Disallow /tmp/
Disallow /cache/
Allow *.css
Allow *.js
Allow *.jpg
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.svg
Allow *.webp
Back to top

Other Records

Field Value
sitemap https://www.learnwise.ai/sitemap.xml
sitemap https://www.learnwise.ai/sitemap.xml
Back to top

Comments

  • By default, all pages are allowed unless disallowed below.
  • Keep private/admin endpoints hidden:
  • Ensure search engines can fetch common file types:
  • Main sitemap:
Back to top