Log In Sign Up

es.iverylab.com
robots.txt

Robots Exclusion Standard data for es.iverylab.com

Resource Scan

Scan Details

Site Domain es.iverylab.com
Base Domain iverylab.com
Scan Status Ok
Last Scan2026-01-31T09:48:27+00:00
Next Scan 2026-03-02T09:48:27+00:00

Last Scan

Scanned2026-01-31T09:48:27+00:00
URL https://es.iverylab.com/robots.txt
Domain IPs 185.32.57.43
Response IP 185.32.57.43
Found Yes
Hash be4f321413cf8e187656d03ab784b5ad5ae112b27f9d4ecf1ed1a0013709612b
SimHash 356adb52c0ef

Groups

*

Rule Path
Allow /
Disallow /my/
Disallow /account/
Disallow /login/
Disallow /register/
Disallow /reset-password/
Disallow /profile/
Disallow /cart/
Disallow /checkout/
Disallow /thank-you/
Disallow /order-confirmation/
Disallow /thumb/*/d/fgs16_*
Disallow /d/fgs16_*
Disallow /thumb/*/d/tpl25_*
Disallow /d/tpl25_*
Disallow /thumb/*/d/stp25_*
Disallow /d/stp25_*
Allow *.css$
Allow *.js$
Allow *.jpg$
Allow *.jpeg$
Allow *.png$
Allow *.gif$
Allow *.webp$
Allow *.svg$

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://es.iverylab.com/sitemap.xml
sitemap https://es.iverylab.com/sitemap.xml.gz
Back to top

Comments

  • =============================================================================
  • ROBOTS.TXT FOR iverylab.com - INTERNATIONAL ECOMMERCE
  • FINAL VERSION - FULLY OPTIMIZED FOR SEO 2026
  • =============================================================================
  • Default rules for all bots
  • Block private/admin areas
  • Block shopping cart and checkout
  • Block auto-generated/system pages (MegaGroup specific)
  • Allow crawling of CSS, JS, and images (important for rendering)
  • =============================================================================
  • CLEAN PARAMETERS (Better than Disallow for URL parameters)
  • Tells Google these parameters don't create new content - treats as same page
  • =============================================================================
  • =============================================================================
  • CRAWL OPTIMIZATION
  • =============================================================================
  • Request rate (average requests per hour) - Google's recommended crawl rate
  • msnbot (Bing crawler) - conservative crawl rate
  • =============================================================================
  • GOOGLE IMAGES BOT
  • =============================================================================
  • Explicitly allow Google Images bot to crawl product images
  • =============================================================================
  • SITEMAPS FOR ALL 13 DOMAINS
  • Order: Main domain first, then all subdomains
  • =============================================================================
  • =============================================================================
  • END OF ROBOTS.TXT
  • =============================================================================
  • Last updated: January 28, 2026
  • Version: 2.0 (Final Optimized)
Back to top

Warnings

  • `clean-param` is not a known field.
  • `request-rate` is not a known field.
Back to top