Log In Sign Up

tevilive.app
robots.txt

Robots Exclusion Standard data for tevilive.app

Resource Scan

Scan Details

Site Domain tevilive.app
Base Domain tevilive.app
Scan Status Ok
Last Scan2025-11-12T17:25:32+00:00
Next Scan 2025-11-19T17:25:32+00:00

Last Scan

Scanned2025-11-12T17:25:32+00:00
URL https://tevilive.app/robots.txt
Redirect https://tevi.com/robots.txt
Redirect Domain tevi.com
Redirect Base tevi.com
Domain IPs 104.21.14.126, 172.67.203.91, 2606:4700:3036::6815:e7e, 2606:4700:3037::ac43:cb5b
Redirect IPs 104.26.0.87, 104.26.1.87, 172.67.74.126, 2606:4700:20::681a:157, 2606:4700:20::681a:57, 2606:4700:20::ac43:4a7e
Response IP 104.26.1.87
Found Yes
Hash 0d9c1ed50ad784c0bdd7d56472465299e5dbd2ea077bcc11ab6d5715610d966e
SimHash 6307597360f0

Groups

*

Rule Path Comment
Allow / -
Disallow /*?* -
Disallow /*utm_* -
Disallow /*ref%3D* -
Disallow /*fbclid%3D* -
Disallow /*gclid%3D* -
Disallow /api/ -
Disallow /404 -
Disallow /500 -
Disallow /login -
Disallow /signup -
Disallow /*/%40* Blocks /@username format
Allow /css/ -
Allow /js/ -
Allow /images/ -
Allow /fonts/ -
Allow /assets/ -
Allow /monetization/ -
Allow /comparison/ -
Allow /about-tevi/ -
Allow /blogs/ -

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://tevi.com/sitemap.xml
Back to top

Comments

  • Tevi.com Robots.txt - Production Optimized
  • Last updated: 2025-06-03
  • Block URL parameters and tracking (main concern for Tevi)
  • Block login and signup flows (not valuable for SEO)
  • Allow all assets for proper page rendering
  • Allow all SEO-important directories
  • Sitemap location
  • Optional: Crawl delay for server protection
Back to top