dithclerk.com
robots.txt
Robots Exclusion Standard data for dithclerk.com
Resource Scan
Scan Details
| Site Domain | dithclerk.com |
| Base Domain | dithclerk.com |
| Scan Status | Ok |
| Last Scan | 2025-10-29T07:46:39+00:00 |
| Next Scan | 2025-11-05T07:46:39+00:00 |
Last Scan
| Scanned | 2025-10-29T07:46:39+00:00 |
| URL | https://dithclerk.com/robots.txt |
| Domain IPs | 104.18.11.62 |
| Response IP | 104.18.11.62 |
| Found | Yes |
| Hash | e86c14fb59c670e84c127ca0715e4d42fca08fc791390a35e24442df09b88fef |
| SimHash | ecf54c248d01 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /policies/refund-policy |
| Disallow | /policies/terms-of-service |
| Disallow | /policies/shipping-policy |
| Disallow | /policies/contact-us |
| Disallow | /policies/privacy-policy |
| Disallow | /policies/about-us |
| Disallow | /pages/* |
| Disallow | /products/* |
| Disallow | /collections/* |
| Disallow | /collections |
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /orders |
| Disallow | /checkout |
| Disallow | /checkouts |
| Disallow | /account |