awards.com
robots.txt
Robots Exclusion Standard data for awards.com
Resource Scan
Scan Details
| Site Domain | awards.com |
| Base Domain | awards.com |
| Scan Status | Ok |
| Last Scan | 2024-05-20T05:19:39+00:00 |
| Next Scan | 2024-06-19T05:19:39+00:00 |
Last Scan
| Scanned | 2024-05-20T05:19:39+00:00 |
| URL | https://awards.com/robots.txt |
| Redirect | https://www.awards.com:443/robots.txt |
| Redirect Domain | www.awards.com |
| Redirect Base | awards.com |
| Domain IPs | 184.73.175.129, 3.93.207.147 |
| Redirect IPs | 116.51.25.117, 116.51.25.118, 116.51.25.119, 116.51.25.120 |
| Response IP | 116.51.25.119 |
| Found | Yes |
| Hash | d3dd2356cbb7f1f51b96d5b79eed81b92c04a03982f0569f58266a8b56095a7f |
| SimHash | 6d719e54c79b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /proof/ |
| Disallow | /cart |
| Disallow | /cart/added |
| Disallow | /account |
| Disallow | /signup |
| Disallow | /sp/ |
| Disallow | /search/products/ |
| Disallow | /quote-request/ |
| Disallow | /pop-zoom/ |
| Disallow | /account/shipping |
| Disallow | /reviews/write/ |
| Disallow | /unsubscribe |
| Disallow | /checkout/print/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.awards.com/sitemap/index.xml |