modelstorage.com
robots.txt
Robots Exclusion Standard data for modelstorage.com
Resource Scan
Scan Details
| Site Domain | modelstorage.com |
| Base Domain | modelstorage.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-10-07T03:40:36+00:00 |
| Next Scan | 2025-01-05T03:40:36+00:00 |
Last Successful Scan
| Scanned | 2024-02-18T03:38:54+00:00 |
| URL | https://modelstorage.com/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:3:8a4f, 2a00:15f8:a000:5:1:12:3:8a4f, 2a00:15f8:a000:5:1:13:3:8a4f, 2a00:15f8:a000:5:1:14:3:8a4f, 90.156.201.47, 90.156.201.48, 90.156.201.56, 90.156.201.59 |
| Response IP | 90.156.201.48 |
| Found | Yes |
| Hash | ca150020882fa697a3ae3b2823d1c57627e881a22aa03e139b591e51dc50dded |
| SimHash | cf19df5ac333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /about/ |
| Disallow | /cart/ |
| Disallow | /contact/ |
| Disallow | /partnership/ |
| Disallow | /privacy-policy/ |
| Disallow | /terms/ |
| Disallow | /payments/ |
| Disallow | /topup/ |
| Disallow | /user/ |
| Disallow | /dashboard/ |
| Disallow | /signup/ |
| Disallow | /request-reset/ |
| Disallow | */search/* |
| Disallow | */buy/* |
| Disallow | */addtocart/* |
| Disallow | */addtocard/* |
| Disallow | */removefromcart/* |
| Disallow | *?action* |