Log In Sign Up

energytraining.ae
robots.txt

Robots Exclusion Standard data for energytraining.ae

Resource Scan

Scan Details

Site Domain energytraining.ae
Base Domain energytraining.ae
Scan Status Ok
Last Scan2026-01-25T22:58:15+00:00
Next Scan 2026-02-24T22:58:15+00:00

Last Scan

Scanned2026-01-25T22:58:15+00:00
URL https://energytraining.ae/robots.txt
Domain IPs 104.26.0.48, 104.26.1.48, 172.67.74.122, 2606:4700:20::681a:130, 2606:4700:20::681a:30, 2606:4700:20::ac43:4a7a
Response IP 104.26.0.48
Found Yes
Hash 15e71fd2d020c7bd5721ae8344b7151481fa2211b8f650052dbe3617fdfb8916
SimHash c620de21a7eb

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-json/
Disallow /?s=
Disallow /*?s=
Disallow /*?replytocom=
Disallow /*?attachment_id=
Disallow /*?utm_
Disallow /*?fbclid=
Disallow /*?gclid=
Disallow /wp-content/uploads/wp-import-export-lite/

nuclei
wikido
riddler
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://energytraining.ae/sitemap_index.xml
Back to top

Comments

  • =====================================
  • Robots.txt for energytraining.ae
  • SEO-safe for WordPress training website
  • =====================================
  • -------------------------------------
  • WordPress admin (standard)
  • -------------------------------------
  • -------------------------------------
  • Block technical endpoints
  • -------------------------------------
  • -------------------------------------
  • Block internal search results (safe)
  • -------------------------------------
  • -------------------------------------
  • Block common low-value parameters
  • -------------------------------------
  • -------------------------------------
  • Optional: block tracking parameters (recommended)
  • -------------------------------------
  • -------------------------------------
  • If you use an import/export plugin and want to hide its uploads
  • -------------------------------------
  • -------------------------------------
  • Sitemap
  • -------------------------------------
  • -------------------------------------
  • Block useless / harmful bots
  • -------------------------------------
Back to top