todosnegocios.com
robots.txt

Robots Exclusion Standard data for todosnegocios.com

Resource Scan

Scan Details

Site Domain todosnegocios.com
Base Domain todosnegocios.com
Scan Status Ok
Last Scan2026-02-21T17:05:13+00:00
Next Scan 2026-02-28T17:05:13+00:00

Last Scan

Scanned2026-02-21T17:05:13+00:00
URL https://todosnegocios.com/robots.txt
Domain IPs 104.26.10.81, 104.26.11.81, 172.67.70.223, 2606:4700:20::681a:a51, 2606:4700:20::681a:b51, 2606:4700:20::ac43:46df
Response IP 104.26.10.81
Found Yes
Hash dffb28e7fa166a4294ab655dfd0f5c6ebf3119b62fb6b5673cc534c66195dde7
SimHash a9104b52d773

Groups

cliqzbot

Rule Path
Disallow /

getintent

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /edit/
Disallow /cdn-cgi/
Disallow /dynjs/
Disallow /dyn/actions/
Disallow /es/search?
Disallow /pt/search?
Allow /

Other Records

Field Value
sitemap https://todosnegocios.com/sitemaps/sitemap_index.xml