gemexi.com
robots.txt

Robots Exclusion Standard data for gemexi.com

Resource Scan

Scan Details

Site Domain gemexi.com
Base Domain gemexi.com
Scan Status Ok
Last Scan2025-11-10T20:51:06+00:00
Next Scan 2025-12-10T20:51:06+00:00

Last Scan

Scanned2025-11-10T20:51:06+00:00
URL https://gemexi.com/robots.txt
Redirect https://www.gemexi.com/robots.txt
Redirect Domain www.gemexi.com
Redirect Base gemexi.com
Domain IPs 104.21.52.208, 172.67.203.230, 2606:4700:3031::ac43:cbe6, 2606:4700:3034::6815:34d0
Redirect IPs 104.21.52.208, 172.67.203.230, 2606:4700:3031::ac43:cbe6, 2606:4700:3034::6815:34d0
Response IP 104.21.52.208
Found Yes
Hash 5381de18909134a1dac6e2eb70ada1ca295e8b061d550856b3456480b2de22c7
SimHash e94db475d9fb

Groups

*

Rule Path
Disallow /comments/
Disallow /demo/
Disallow /blog/news/*
Disallow /gemstones/jewelry_detail/*
Disallow /products/search/*
Disallow /gemstones/home/*
Disallow /cgi-bin/
Disallow /Gemstones/update_size_filter
Disallow /Gemstones/update*
Disallow /app/webroot/js/*
Disallow /*ror.xml
Disallow /users/login/*
Disallow /testing/*
Disallow /global/jewelry-brands/nature-s-treasure
Disallow /blog/fashion/reveal-the-top-five-mysteries-of-the-five-elements-that-lies-in-the-world
Disallow /blog/fashion/cure-the-feeling-of-apathy-with-the-power-of-gemstones
Disallow /gemstones/jewelry/rhodonite/2/Product.if_exclusive/DESC
Disallow /products/removefromcart

Other Records

Field Value
sitemap https://www.gemexi.com/sitemap.xml
sitemap https://www.gemexi.com/sitemap/gemstone-sitemap.xml
sitemap https://www.gemexi.com/sitemap/page-sitemap.xml