bindi-online.com
robots.txt

Robots Exclusion Standard data for bindi-online.com

Resource Scan

Scan Details

Site Domain bindi-online.com
Base Domain bindi-online.com
Scan Status Ok
Last Scan2025-06-01T20:21:53+00:00
Next Scan 2025-07-01T20:21:53+00:00

Last Scan

Scanned2025-06-01T20:21:53+00:00
URL https://bindi-online.com/robots.txt
Domain IPs 178.211.133.45
Response IP 178.211.133.45
Found Yes
Hash b6a9abe9f8b974172837a399d765f969b2246ab07478591344affe7b01fa6dfa
SimHash e49852c2cc21

Groups

*

Rule Path
Allow /wp-content/*/*.jpg
Allow /wp-content/*/*.png
Allow /wp-content/*/*.gif
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Allow /wp-content/themes/*.css
Allow /wp-content/themes/*.js
Allow /wp-includes/*/*.png
Allow /wp-includes/*/*.js
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-login/
Disallow /wp-admin/
Disallow /*/page/
Disallow /sku/
Disallow /?s=
Disallow /*/?*
Disallow /search
Disallow /*/*/*/feed.xml
Disallow /?attachment_id*
Disallow /*/feed/
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /*add-to-cart%3D*
Disallow /carrito/
Disallow /old/
Disallow /finalizar-compra/
Disallow /mi-cuenta/

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bindi-online.com/sitemap_index.xml
sitemap https://bindi-online.com/post-sitemap.xml
sitemap https://bindi-online.com/page-sitemap.xml
sitemap https://bindi-online.com/product_cat-sitemap.xml
sitemap https://bindi-online.com/product-sitemap1.xml
sitemap https://bindi-online.com/product-sitemap2.xml
sitemap https://bindi-online.com/product-sitemap3.xml

Comments

  • Bloqueo de bots y crawlers poco utiles