Log In Sign Up

alestemple.net
robots.txt

Robots Exclusion Standard data for alestemple.net

Resource Scan

Scan Details

Site Domain alestemple.net
Base Domain alestemple.net
Scan Status Ok
Last Scan2026-02-07T17:44:23+00:00
Next Scan 2026-02-14T17:44:23+00:00

Last Scan

Scanned2026-02-07T17:44:23+00:00
URL https://alestemple.net/robots.txt
Domain IPs 62.171.191.39
Response IP 62.171.191.39
Found Yes
Hash 692b12e66341753b9b3f70eb3c8f28b567f31d80c756085ba3d63a54229af5cb
SimHash 08aa0273f1c6

Groups

*

Rule Path
Allow /
Allow /images/
Allow /css/
Allow /js/
Allow /video/
Allow /download/
Disallow /admin-login.html
Disallow /admin/
Disallow /admin-dashboard/
Disallow /admin.js
Disallow /backend/
Disallow /api.php
Disallow /app.js
Disallow /config/
Disallow /cgi-bin/
Disallow /logs/
Disallow /.well-known/
Disallow /node_modules/
Disallow /.env
Disallow /.ftpquota
Disallow /.htaccess
Disallow /dist/
Disallow /tmp/
Disallow /test/
Disallow /*.env
Disallow /*.log
Disallow /*.json
Disallow /*.csv
Disallow /unsubscribe.html
Disallow /update-preferences.html

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeek/0.0

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

googlebot-image

Rule Path
Allow /images/

googlebot-video

Rule Path
Allow /video/

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

pinterest

Rule Path
Allow /

slackbot

Rule Path
Allow /

uptime.com

Rule Path
Allow /

uptimerobot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://alestemple.net/sitemap.xml
sitemap https://alestemple.net/sitemap-products.xml
sitemap https://alestemple.net/sitemap-images.xml
sitemap https://alestemple.net/sitemap-videos.xml
Back to top

Comments

  • robots.txt for alestemple.net
  • SEO Optimized - Google Best Practices
  • Updated: January 22, 2026
  • Professional Video Templates | VEGAS Pro, Movie Studio, Effects, LUTs
  • ============================================
  • STANDARD CRAWLERS - ALLOW PUBLIC CONTENT
  • ============================================
  • Crawl delay optimization (1 second to reduce server load while maintaining crawl efficiency)
  • ============================================
  • ADMIN & BACKEND - COMPLETELY DISALLOW
  • ============================================
  • Admin login page - PRIMARY EXCLUSION
  • Admin dashboard and management
  • Backend services and APIs
  • System and configuration directories
  • Environment and temporary files
  • Log and data files
  • Disallow email utility pages
  • ============================================
  • SPECIFIC BOT RESTRICTIONS
  • ============================================
  • Aggressive crawlers - block entirely (competitive intelligence bots)
  • ============================================
  • MAJOR SEARCH ENGINES - FULL ACCESS
  • ============================================
  • Google crawlers - no delay
  • Bing crawlers - no delay
  • Other search engines
  • ============================================
  • SOCIAL MEDIA CRAWLERS - ALLOW
  • ============================================
  • ============================================
  • MONITORING & ANALYTICS - ALLOW
  • ============================================
  • ============================================
  • SITEMAP REFERENCES - CRITICAL FOR SEO
  • ============================================
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top