quiminet.com.mx
robots.txt

Robots Exclusion Standard data for quiminet.com.mx

Resource Scan

Scan Details

Site Domain quiminet.com.mx
Base Domain quiminet.com.mx
Scan Status Ok
Last Scan2024-11-11T08:23:18+00:00
Next Scan 2024-11-18T08:23:18+00:00

Last Scan

Scanned2024-11-11T08:23:18+00:00
URL https://quiminet.com.mx/robots.txt
Redirect https://www.quiminet.com/robots.txt
Redirect Domain www.quiminet.com
Redirect Base quiminet.com
Domain IPs 104.21.0.98, 172.67.150.211, 2606:4700:3033::6815:62, 2606:4700:3034::ac43:96d3
Redirect IPs 104.24.14.79, 104.24.15.79, 172.67.66.120, 2606:4700:20::6818:e4f, 2606:4700:20::6818:f4f, 2606:4700:20::ac43:4278
Response IP 104.24.14.79
Found Yes
Hash 4bfbd75d56e6d6c7cf8ea29d68f67f9f918111c5538078721f33c32a65f0444b
SimHash 0f1f8140f6b4

Groups

bingbot

Rule Path
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/

googlebot

Rule Path
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /*/impresion/*
Disallow /*/print/*
Disallow /forms/
Disallow /contactar/
Disallow /principal/img/
Disallow /asp/
Disallow /user/
Allow /funciones/jq/qn/leyendas/

mediapartners-google

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

adsbot-google

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

adsbot-google-mobile

Rule Path
Allow *
Disallow /invisible/
Disallow /funciones/
Disallow /f/
Disallow /user/

googlebot-image

Rule Path
Disallow /productos/img/
Disallow /private/
Disallow /invisible/
Disallow /inv/
Disallow /mi/
Disallow /my/
Disallow /funciones/
Disallow /f/
Disallow /user/

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

speedy

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sistrix

Rule Path
Disallow /

discobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

linguee

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.