faithful-to-nature.co.za
robots.txt
Robots Exclusion Standard data for faithful-to-nature.co.za
Resource Scan
Scan Details
| Site Domain | faithful-to-nature.co.za |
| Base Domain | faithful-to-nature.co.za |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-17T19:09:19+00:00 |
| Next Scan | 2024-06-15T19:09:19+00:00 |
Last Successful Scan
| Scanned | 2023-07-27T06:25:49+00:00 |
| URL | https://faithful-to-nature.co.za/robots.txt |
| Domain IPs | 104.26.14.190, 104.26.15.190, 172.67.71.218, 2606:4700:20::681a:ebe, 2606:4700:20::681a:fbe, 2606:4700:20::ac43:47da |
| Response IP | 104.26.15.190 |
| Found | Yes |
| Hash | 53ab2d1daf188bc90bef3d74a5ea5a54ffb3d28d9852e328d9f691e0391d94a9 |
| SimHash | a5140af7ce93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*customer/account/ |
| Disallow | /*addItem/product/ |
| Disallow | /*review/product/ |
| Disallow | /*wishlist/ |
| Disallow | /checkout/ |
| Disallow | /*checkout/cart/ |
| Allow | /customer/account/create/ |
| Allow | *?smplid= |
| Allow | *?sfdr_ptcid= |
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.faithful-to-nature.co.za/media/sitemap.xml |
| sitemap | https://www.faithful-to-nature.co.za/blog/sitemap_index.xml |
Warnings
- `user agent` is not a known field.