e-industria.com
robots.txt

Robots Exclusion Standard data for e-industria.com

Resource Scan

Scan Details

Site Domain e-industria.com
Base Domain e-industria.com
Scan Status Ok
Last Scan2024-09-16T16:03:08+00:00
Next Scan 2024-09-23T16:03:08+00:00

Last Scan

Scanned2024-09-16T16:03:08+00:00
URL https://e-industria.com/robots.txt
Redirect http://www.eindustria.com/robots.txt
Redirect Domain www.eindustria.com
Redirect Base eindustria.com
Domain IPs 104.21.46.207, 172.67.141.203, 2606:4700:3033::ac43:8dcb, 2606:4700:3037::6815:2ecf
Redirect IPs 104.21.28.148, 172.67.146.190, 2606:4700:3031::ac43:92be, 2606:4700:3033::6815:1c94
Response IP 172.67.146.190
Found Yes
Hash 4bfbd75d56e6d6c7cf8ea29d68f67f9f918111c5538078721f33c32a65f0444b
SimHash 0f1f8140f6b4

Groups

bingbot

Rule Path
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

googlebot

Rule Path
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/
Allow /funciones/jq/qn/leyendas/

mediapartners-google

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

adsbot-google

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

adsbot-google-mobile

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

googlebot-image

Rule Path
Disallow /productos/img/
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /user/

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

speedy

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sistrix

Rule Path
Disallow /

discobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

linguee

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.