gem.com
robots.txt

Robots Exclusion Standard data for gem.com

Resource Scan

Scan Details

Site Domain gem.com
Base Domain gem.com
Scan Status Ok
Last Scan2024-06-23T12:02:30+00:00
Next Scan 2024-07-23T12:02:30+00:00

Last Scan

Scanned2024-06-23T12:02:30+00:00
URL https://gem.com/robots.txt
Redirect https://www.gem.com/robots.txt
Redirect Domain www.gem.com
Redirect Base gem.com
Domain IPs 13.35.18.118, 13.35.18.127, 13.35.18.2, 13.35.18.30
Redirect IPs 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81
Response IP 18.205.222.128
Found Yes
Hash 8ddd214127d4cca1f3cd07aef43d1a122471b01e148effbcef29d947fa440dd0
SimHash 5c28cca5a2d1

Groups

*

Rule Path
Disallow /trial/

Other Records

Field Value
sitemap https://lp.gem.com/rs/972-IVV-330/images/lp_sitemap.xml
sitemap https://www.gem.com/sitemap.xml
sitemap https://www.gem.com/dynamic-sitemap.xml
sitemap https://www.gem.com/api/sitemap.xml