Log In Sign Up

extracolumna.com
robots.txt

Robots Exclusion Standard data for extracolumna.com

Resource Scan

Scan Details

Site Domain extracolumna.com
Base Domain extracolumna.com
Scan Status Ok
Last Scan2025-10-20T16:56:47+00:00
Next Scan 2025-11-19T16:56:47+00:00

Last Scan

Scanned2025-10-20T16:56:47+00:00
URL https://extracolumna.com/robots.txt
Domain IPs 104.21.47.111, 172.67.147.54, 2606:4700:3030::6815:2f6f, 2606:4700:3037::ac43:9336
Response IP 172.67.147.54
Found Yes
Hash 6f24367d5cc064a32b1167ae0e5fb324efe5f3f4288f1b0841e0b175dce8c516
SimHash 1314dd94dcc1

Groups

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sebot

Rule Path
Disallow /

sebot-wa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

screamingfrogseospider

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

netpeak spider

Rule Path
Disallow /

netpeakspider

Rule Path
Disallow /

panscient

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

search.marginalia.nu

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

commoncrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://extracolumna.com/sitemap_index.xml
Back to top

Comments

  • --- Custom Robots Bots Blocker (modo AMPLIO) ---
  • Nota: robots.txt es una política voluntaria; algunos bots pueden ignorarla.
  • Ajusta la lista $bots según tus necesidades.
  • Buscadores permitidos: Googlebot, Googlebot-Image, Google-InspectionTool, Mediapartners-Google, AdsBot-Google, Bingbot, DuckDuckBot, Applebot, Yahoo! Slurp, YandexBot
  • --- Fin Custom Robots Bots Blocker ---
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top