libidex.com
robots.txt

Robots Exclusion Standard data for libidex.com

Resource Scan

Scan Details

Site Domain libidex.com
Base Domain libidex.com
Scan Status Ok
Last Scan2025-10-09T10:19:57+00:00
Next Scan 2025-11-08T10:19:57+00:00

Last Scan

Scanned2025-10-09T10:19:57+00:00
URL https://libidex.com/robots.txt
Domain IPs 104.26.10.119, 104.26.11.119, 172.67.69.160, 2606:4700:20::681a:a77, 2606:4700:20::681a:b77, 2606:4700:20::ac43:45a0
Response IP 104.26.10.119
Found Yes
Hash 4a720605a181679be0f99c90c75cc2232a5209bfab38a0b8e36ce1779a8ea8e3
SimHash f3047114cbfb

Groups

*

Rule Path
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /wishlist/
Disallow /index.php/customer/account/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /search/
Disallow /*?*dir=
Disallow /*?*mode=
Disallow /*?*price=
Disallow /*?*product_list_order=
Disallow /*?*price_from=
Disallow /*?*price_to=
Disallow /*?*product_list_mode=
Disallow /*?*product_list_dir=
Disallow /*?*limit=
Disallow /*?*order=
Disallow /*?*options=
Disallow /*?*cat=
Disallow /*?*SID=
Disallow /*PHPSESSID
Disallow /*?*XDEBUG_SESSION_START=
Disallow /*?*XDEBUG_SESSION=
Allow /*?p=
Disallow /*?p=*&

Other Records

Field Value
sitemap https://libidex.com/sitemap_libidex/sitemap.xml

Comments

  • Sitemap
  • Crawlers
  • Customer & checkout
  • Search & compare
  • Params (blocks parameters appearing anywhere in query string)
  • Session IDs
  • Pagination (only if it's the sole parameter)