Log In Sign Up

tevi.com
robots.txt

Robots Exclusion Standard data for tevi.com

Resource Scan

Scan Details

Site Domain tevi.com
Base Domain tevi.com
Scan Status Ok
Last Scan2025-10-31T10:04:33+00:00
Next Scan 2025-11-07T10:04:33+00:00

Last Scan

Scanned2025-10-31T10:04:33+00:00
URL https://tevi.com/robots.txt
Domain IPs 104.20.39.114, 172.66.159.39, 2606:4700:10::6814:2772, 2606:4700:10::ac42:9f27
Response IP 172.66.159.39
Found Yes
Hash 0d9c1ed50ad784c0bdd7d56472465299e5dbd2ea077bcc11ab6d5715610d966e
SimHash 6307597360f0

Groups

*

Rule Path Comment
Allow / -
Disallow /*?* -
Disallow /*utm_* -
Disallow /*ref%3D* -
Disallow /*fbclid%3D* -
Disallow /*gclid%3D* -
Disallow /api/ -
Disallow /404 -
Disallow /500 -
Disallow /login -
Disallow /signup -
Disallow /*/%40* Blocks /@username format
Allow /css/ -
Allow /js/ -
Allow /images/ -
Allow /fonts/ -
Allow /assets/ -
Allow /monetization/ -
Allow /comparison/ -
Allow /about-tevi/ -
Allow /blogs/ -

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://tevi.com/sitemap.xml
Back to top

Comments

  • Tevi.com Robots.txt - Production Optimized
  • Last updated: 2025-06-03
  • Block URL parameters and tracking (main concern for Tevi)
  • Block login and signup flows (not valuable for SEO)
  • Allow all assets for proper page rendering
  • Allow all SEO-important directories
  • Sitemap location
  • Optional: Crawl delay for server protection
Back to top