mohito.com
robots.txt
Robots Exclusion Standard data for mohito.com
Resource Scan
Scan Details
Site Domain | mohito.com |
Base Domain | mohito.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-08T06:13:28+00:00 |
Next Scan | 2025-02-06T06:13:28+00:00 |
Last Successful Scan
Scanned | 2024-04-06T05:51:59+00:00 |
URL | https://mohito.com/robots.txt |
Redirect | https://www.mohito.com/robots.txt |
Redirect Domain | www.mohito.com |
Redirect Base | mohito.com |
Domain IPs | 23.59.168.162, 23.59.168.168, 2600:1413:b000:1b::17d7:719, 2600:1413:b000:1b::17d7:71a |
Redirect IPs | 23.59.168.162, 23.59.168.168, 2600:1413:b000:1b::17d7:719, 2600:1413:b000:1b::17d7:71a |
Response IP | 96.17.180.190 |
Found | Yes |
Hash | ab5a04586e77837bbca0751b75a7f9688bae3028a09ea67ae440fdbad2f4c58c |
SimHash | 4e5984144bd6 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/*/checkout/ |
Disallow | /*/*/customer/ |
Disallow | /*/*/wishlist/ |
Disallow | /*/*/js/ |
Disallow | /*/*/ajx/ |
Disallow | /*/*/ajax/ |
Disallow | /*/*/zsales/ |
Disallow | /*/*/ordertracking/ |
Disallow | /*/*/sizetable/ |
Disallow | /*/*/metrics/ |
Disallow | /*/*/order/ |
Disallow | /*/*/myaccount/ |
Disallow | /*/*/apple/session/create/ |
Disallow | /*1test* |
Disallow | /*2test* |
Disallow | /*3test* |
Disallow | /*4test* |
Disallow | /*5test* |
Disallow | /*6test* |
Disallow | /*7test* |
Disallow | /*8test* |
Disallow | /*9test* |
Disallow | /*0test* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://static.mohito.com/sitemaps/sitemap.xml.gz |