Log In Sign Up

techvoot.com
robots.txt

Robots Exclusion Standard data for techvoot.com

Resource Scan

Scan Details

Site Domain techvoot.com
Base Domain techvoot.com
Scan Status Ok
Last Scan2025-09-23T22:44:42+00:00
Next Scan 2025-10-23T22:44:42+00:00

Last Scan

Scanned2025-09-23T22:44:42+00:00
URL https://techvoot.com/robots.txt
Redirect https://www.techvoot.com/robots.txt
Redirect Domain www.techvoot.com
Redirect Base techvoot.com
Domain IPs 216.10.252.54
Redirect IPs 216.10.252.54
Response IP 216.10.252.54
Found Yes
Hash b010f0086f8084078f751e3a0749c03bc5b065efa84ee8baea26b94523bc6b16
SimHash 7a14d501d7e1

Groups

*

Rule Path
Disallow
Disallow /public/
Disallow /beta/
Disallow /page/
Disallow /frontend/
Disallow /404/
Disallow /blog/tag/
Allow /blog/
Allow /frontend/images/
Disallow /*?page=
Back to top

Other Records

Field Value
sitemap https://www.techvoot.com/sitemap.xml
Back to top

Comments

  • Directories
  • Disallow: /storage/
  • Disallow filter urls
  • Allow social media bots .
  • User-agent: Twitterbot
  • Allow: /storage/
  • User-agent: facebookexternalhit
  • Allow: /storage/
  • Crawl-delay: 10
Back to top