desertrat.com
robots.txt
Robots Exclusion Standard data for desertrat.com
Resource Scan
Scan Details
| Site Domain | desertrat.com |
| Base Domain | desertrat.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T13:06:35+00:00 |
| Next Scan | 2024-10-20T13:06:35+00:00 |
Last Scan
| Scanned | 2024-09-20T13:06:35+00:00 |
| URL | https://desertrat.com/robots.txt |
| Redirect | https://www.desertrat.com/robots.txt |
| Redirect Domain | www.desertrat.com |
| Redirect Base | desertrat.com |
| Domain IPs | 67.207.213.76 |
| Redirect IPs | 67.207.213.76 |
| Response IP | 67.207.213.76 |
| Found | Yes |
| Hash | b4e922fd487ce167dd0ad29b6a3c296e4bf2a767a3ffe0ac0f0b96a8270a4165 |
| SimHash | a2900c6286c2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /cgi-bin |
| Disallow | /modlogan |
| Disallow | /webalizer |
| Disallow | /cart.html |
| Disallow | /checkout.html |
| Disallow | /account.html |
| Disallow | /account/* |
| Disallow | /wishlist.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.desertrat.com/sitemap_index.xml |
Comments