gemsnav.com
robots.txt

Robots Exclusion Standard data for gemsnav.com

Resource Scan

Scan Details

Site Domain gemsnav.com
Base Domain gemsnav.com
Scan Status Ok
Last Scan2025-09-25T23:44:27+00:00
Next Scan 2025-10-25T23:44:27+00:00

Last Scan

Scanned2025-09-25T23:44:27+00:00
URL https://www.gemsnav.com/robots.txt
Domain IPs 13.35.202.13, 13.35.202.19, 13.35.202.26, 13.35.202.90, 2600:9000:2078:2c00:6:5cd9:26c0:93a1, 2600:9000:2078:4a00:6:5cd9:26c0:93a1, 2600:9000:2078:5400:6:5cd9:26c0:93a1, 2600:9000:2078:7e00:6:5cd9:26c0:93a1, 2600:9000:2078:8800:6:5cd9:26c0:93a1, 2600:9000:2078:8a00:6:5cd9:26c0:93a1, 2600:9000:2078:8c00:6:5cd9:26c0:93a1, 2600:9000:2078:d600:6:5cd9:26c0:93a1
Response IP 13.35.202.13
Found Yes
Hash 9df9d906649cc85337991c15998f2c1a133040cfee2381f8e16dee47233f4719
SimHash 71058ddc0d13

Groups

*

Rule Path
Disallow /m-login
Disallow /ce_make.html
Disallow /verify110manu.html
Disallow /ce_cust_403.html
Disallow /verify430manu.html
Disallow /cyproductlist_1/
Disallow /verify.html

baiduspider/2.0

Rule Path
Disallow /producer/
Disallow /thirdcode/
Disallow /nportal/
Disallow /icp
Disallow *api*
Disallow *.php
Disallow *.asp
Disallow /admin/
Disallow /npublic/
Disallow /site.txt

Other Records

Field Value
sitemap https://www.gemsnav.com/sitemap.xml