pc.shopcider.com
robots.txt
Robots Exclusion Standard data for pc.shopcider.com
Resource Scan
Scan Details
| Site Domain | pc.shopcider.com |
| Base Domain | shopcider.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-17T05:24:50+00:00 |
| Next Scan | 2024-12-16T05:24:50+00:00 |
Last Successful Scan
| Scanned | 2024-06-18T00:47:59+00:00 |
| URL | http://pc.shopcider.com/robots.txt |
| Redirect | https://www.shopcider.com/robots.txt |
| Redirect Domain | www.shopcider.com |
| Redirect Base | shopcider.com |
| Domain IPs | 47.89.156.14 |
| Redirect IPs | 23.209.46.142, 23.209.46.159 |
| Response IP | 96.17.180.130 |
| Found | Yes |
| Hash | f966f361fa3b32b5ee71d8ebb4a1c05c598b2915bc4b33c0787cd525cb6d4d88 |
| SimHash | f0825d1ea1d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /payment/ |
| Disallow | /cart/ |
| Disallow | /user/ |
| Disallow | /order/ |
| Disallow | /review/ |
| Disallow | /activityConfig/ |
| Disallow | /blackfriday/dataview |
| Disallow | /login/reset |
| Disallow | /from-mall-store/ |
| Disallow | /collection/*test* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shopcider.com/sitemap.xml |
Comments