contamex.com
robots.txt

Robots Exclusion Standard data for contamex.com

Resource Scan

Scan Details

Site Domain contamex.com
Base Domain contamex.com
Scan Status Ok
Last Scan2024-11-09T21:40:09+00:00
Next Scan 2024-11-16T21:40:09+00:00

Last Scan

Scanned2024-11-09T21:40:09+00:00
URL https://contamex.com/robots.txt
Redirect http://www.contamex.com/robots.txt
Redirect Domain www.contamex.com
Redirect Base contamex.com
Domain IPs 104.21.41.247, 172.67.167.211, 2606:4700:3035::6815:29f7, 2606:4700:3036::ac43:a7d3
Redirect IPs 104.21.41.247, 172.67.167.211, 2606:4700:3035::6815:29f7, 2606:4700:3036::ac43:a7d3
Response IP 172.67.167.211
Found Yes
Hash b6d822905a3599e75d9cde5ec35f65f7cc17f60971a20cf47b19b7fa7c35d008
SimHash 0a1e87c37632

Groups

bingbot

Rule Path
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /principal/img/
Disallow /user/

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /inv/
Disallow /mi/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /principal/img/
Disallow /user/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /private/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /principal/img/
Disallow /user/

googlebot

Rule Path
Disallow /private/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /principal/img/
Disallow /user/
Allow /funciones/jq/qn/leyendas/

mediapartners-google

Rule Path
Allow *
Disallow /funciones/
Disallow /f/
Disallow /user/

googlebot-image

Rule Path
Disallow /productos/img/
Disallow /private/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /user/

speedy

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sistrix

Rule Path
Disallow /

discobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

linguee

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.