Log In Sign Up

solostocks.com
robots.txt

Robots Exclusion Standard data for solostocks.com

Resource Scan

Scan Details

Site Domain solostocks.com
Base Domain solostocks.com
Scan Status Ok
Last Scan2024-09-17T09:17:07+00:00
Next Scan 2024-09-24T09:17:07+00:00

Last Scan

Scanned2024-09-17T09:17:07+00:00
URL https://solostocks.com/robots.txt
Redirect https://www.solostocks.com/robots.txt
Redirect Domain www.solostocks.com
Redirect Base solostocks.com
Domain IPs 34.240.68.26, 52.19.35.30
Redirect IPs 34.240.68.26, 52.19.35.30
Response IP 34.240.68.26
Found Yes
Hash e8e97fefd450b65c513dde1d0506e25d77bceb375f4d55cdac974a6e92614ad9
SimHash 6f85da5017f2

Groups

shopwiki
accelobot
sapphirewebcrawler
dotbot
charlotte
kalooga
httrack
linguee
ltx71
ahrefsbot
megaindex
blexbot
yandex
sogou spider
proximic
domaincrawler

Rule Path
Disallow /

adsbot-google
adsbot-google-mobile
mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /lotes/*
Disallow /*.htm$
Disallow /*.html$
Disallow /*?o=*
Disallow /*?p=*
Disallow /*?c=*
Disallow /*?cat=*
Disallow /*?cl=*
Disallow /*?pk=*
Disallow /*?a=*
Disallow /*?sp=*
Disallow /*?sd=*
Disallow /*?e=*
Disallow /*?h=*
Disallow /*?f=*
Disallow /*?vd=*
Disallow /*?fs=*
Disallow /*?td=*
Disallow /*?rows=*
Disallow /*?nidx=*
Disallow /venta-productos/*/*_b*
Disallow /compra-productos/*/*_b*
Disallow /empresas/*/*_b*
Disallow /order/*
Disallow /landing/*
Disallow /*?t=LSO
Disallow /*?t=LSE
Disallow /*?t=LSD
Disallow /*?t=LOR
Disallow /*?t=BDO
Disallow /*?t=BDE
Disallow /*?t=BDD
Disallow /*?t=FDO
Disallow /*?t=FVD
Disallow /*?t=FDE
Disallow /*?t=FDD
Disallow /*?t=CO
Disallow /*?t=CE
Disallow /*?t=CD
Disallow /*?t=H
Disallow /*?t=M
Disallow /*?t=T
Disallow /*?t=A
Disallow /*?t=PO
Disallow /*?t=PD
Disallow /*?t=LIN
Disallow /*?t=LOUT
Disallow /*?t=FOF
Disallow /*?search=*
Disallow /admin
Disallow /*.ssi
Back to top

Other Records

Field Value
sitemap https://www.solostocks.com/sitemap_index.xml
Back to top

Comments

  • Frenamos bingbot (1-Slow....10-Extremely Slow)
  • User-Agent: bingbot
  • Crawl-delay: 5
  • Publicidad - Dejamos entrar a todo para validar calidad de pagina
  • All bots que no se ha excluido
  • All bots - Old URLs
  • All bots - Blocking all filtered listing pages
  • All bots - Blocking all filtered search pages (noIndex on page > 100)
  • All bots - Block order pages
  • All bots - Block landing marketing
  • All bots - Blocking URLs de tracking de GA
  • All bots - Blocking cosas raras del Googlebot
Back to top