gearbest.com
robots.txt
Robots Exclusion Standard data for gearbest.com
Resource Scan
Scan Details
Site Domain | gearbest.com |
Base Domain | gearbest.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-12T10:35:07+00:00 |
Next Scan | 2024-06-10T10:35:07+00:00 |
Last Successful Scan
Scanned | 2023-05-15T05:18:55+00:00 |
URL | https://www.gearbest.com/robots.txt |
Domain IPs | 18.167.169.187, 43.152.14.32, 52.220.25.48, 52.76.116.62 |
Response IP | 18.167.169.187 |
Found | Yes |
Hash | e098432e597ed844b80e9cc5c12f99f194e60453ce10a462a680ed0d4c02ac6b |
SimHash | c83c02f26e89 |
Groups
*
Rule | Path |
---|---|
Disallow | /inc/ |
Allow | /static/js/ |
Allow | /static/css/ |
Allow | /static/themes/ |
Allow | /static/themes-v2/ |
Disallow | /static/ |
Disallow | /account/ |
Disallow | /tmp/ |