energeeks.com
robots.txt

Robots Exclusion Standard data for energeeks.com

Resource Scan

Scan Details

Site Domain energeeks.com
Base Domain energeeks.com
Scan Status Ok
Last Scan2025-10-15T10:27:19+00:00
Next Scan 2025-11-14T10:27:19+00:00

Last Scan

Scanned2025-10-15T10:27:19+00:00
URL https://energeeks.com/robots.txt
Domain IPs 178.211.133.94
Response IP 178.211.133.94
Found Yes
Hash bd1d28108d00e3e0f0639a70a51e26affba3801ba4af4e9aef9f6cd6873af47a
SimHash 80118c20b29a

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

applebot

Rule Path
Allow /

crawl

Rule Path
Allow /

semrushbot

Rule Path
Allow /

scrapy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

unknown robot identified by bot*

Rule Path
Disallow /

unknown robot identified by *bot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/

Other Records

Field Value
sitemap https://energeeks.com/sitemaps.xml

Comments

  • Permitir Googlebot y otros bots útiles
  • Bloquear bots no deseados
  • Bloquear bots desconocidos
  • Sitemap