Log In Sign Up

svtechworld.in
robots.txt

Robots Exclusion Standard data for svtechworld.in

Resource Scan

Scan Details

Site Domain svtechworld.in
Base Domain svtechworld.in
Scan Status Ok
Last Scan2025-10-31T21:06:15+00:00
Next Scan 2025-11-30T21:06:15+00:00

Last Scan

Scanned2025-10-31T21:06:15+00:00
URL https://svtechworld.in/robots.txt
Domain IPs 134.209.152.98
Response IP 134.209.152.98
Found Yes
Hash 586c8c63d43c6c865b5e6c96bacfc12e74680206ec8ce827988ac4b450cd7093
SimHash 49c1c55365c0

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /shared_results/
Disallow /test-*.php
Disallow /verify-*.php
Disallow /meta-tags-dashboard.php
Disallow /generate-sitemap.php
Disallow /internal-linking-analyzer.php
Disallow /internal-linking-implementation-tool.php
Disallow /internal-linking-seo-report.php
Disallow /START-HERE.html
Disallow /FIXES-SUMMARY.html
Disallow /INTERNAL-LINKING-GUIDE.html
Disallow /*.md$

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://svtechworld.in/sitemap.xml
Back to top

Comments

  • Block all testing and verification tools
  • Block internal linking analysis tools
  • Block documentation and guide pages
  • Sitemap location (update this with your actual domain)
  • Crawl-delay (optional, in seconds)
Back to top