gemxstore.com
robots.txt

Robots Exclusion Standard data for gemxstore.com

Resource Scan

Scan Details

Site Domain gemxstore.com
Base Domain gemxstore.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-20T01:38:15+00:00
Next Scan 2025-08-18T01:38:15+00:00

Last Successful Scan

Scanned2024-07-01T23:13:39+00:00
URL https://gemxstore.com/robots.txt
Redirect https://www.gemxstore.com/robots.txt
Redirect Domain www.gemxstore.com
Redirect Base gemxstore.com
Domain IPs 18.119.92.49
Redirect IPs 104.26.0.38, 104.26.1.38, 172.67.70.39, 2606:4700:20::681a:126, 2606:4700:20::681a:26, 2606:4700:20::ac43:4627
Response IP 104.26.1.38
Found Yes
Hash ca10b2616706c6cb320f6145e36213faa3554ef0f771e7d22576f2e71b4e58aa
SimHash 03605e01c373

Groups

*

Rule Path
Disallow /

facebookbot

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit/1.1

Rule Path
Allow /
Disallow /nocrawl

facebookexternalhit/1.0

Rule Path
Allow /
Disallow /nocrawl