gurneys.com
robots.txt
Robots Exclusion Standard data for gurneys.com
Resource Scan
Scan Details
| Site Domain | gurneys.com |
| Base Domain | gurneys.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T11:21:51+00:00 |
| Next Scan | 2024-10-25T11:21:51+00:00 |
Last Scan
| Scanned | 2024-09-25T11:21:51+00:00 |
| URL | https://gurneys.com/robots.txt |
| Redirect | https://www.gurneys.com/robots.txt |
| Redirect Domain | www.gurneys.com |
| Redirect Base | gurneys.com |
| Domain IPs | 162.248.104.127 |
| Redirect IPs | 3.227.221.104 |
| Response IP | 23.20.103.98 |
| Found | Yes |
| Hash | d03953a469d5f7e396f58c820dca65526ec2da2260cd2d1618b8d431ce1088eb |
| SimHash | 280e9884e112 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /affiliate |
| Disallow | /eparty* |
| Disallow | /referafriend* |
| Disallow | /subscriptions* |
| Disallow | /view_reviews/* |
| Disallow | /create_review/* |
| Disallow | /category_filter/* |
| Disallow | /minicart* |
| Disallow | /become_an_affiliate |
| Disallow | /category/s?keyword=* |
| Disallow | /search?keyword=* |
| Disallow | /product/*?quickview=true |
| Disallow | /fullsize/* |
| Disallow | /*.gz |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gurneys.com/downloads/index-sitemap.xml |