davidjones.com
robots.txt
Robots Exclusion Standard data for davidjones.com
Resource Scan
Scan Details
| Site Domain | davidjones.com |
| Base Domain | davidjones.com |
| Scan Status | Ok |
| Last Scan | 2024-09-09T22:47:07+00:00 |
| Next Scan | 2024-10-09T22:47:07+00:00 |
Last Scan
| Scanned | 2024-09-09T22:47:07+00:00 |
| URL | https://davidjones.com/robots.txt |
| Redirect | https://www.davidjones.com/robots.txt |
| Redirect Domain | www.davidjones.com |
| Redirect Base | davidjones.com |
| Domain IPs | 45.60.36.99, 45.60.38.99 |
| Redirect IPs | 45.60.244.56 |
| Response IP | 45.60.244.56 |
| Found | Yes |
| Hash | 85a172c5734fbd6f046558c317d6495851b23e257dd45d09b2edc53871d424b8 |
| SimHash | 695cd6581f90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /default.aspx?q=* |
| Allow | /default.aspx?stores* |
| Disallow | /default.aspx?*action=* |
| Disallow | /default.aspx?Z |
| Disallow | /default.aspx?z |
| Disallow | /default.aspx?action=forms |
| Disallow | *?filter* |
| Disallow | *filter%26aspect* |
| Disallow | *All%20Items%26aspect* |
| Disallow | /search?q* |
| Disallow | *refine%3D* |
| Disallow | *sort%3D* |
| Disallow | /productimages/* |
adsbot-google
| Rule | Path |
|---|---|
| Allow | /default.aspx?q=* |
| Allow | /default.aspx?stores* |
| Disallow | /default.aspx?*action=* |
| Disallow | /default.aspx?Z |
| Disallow | /default.aspx?z |
| Disallow | /default.aspx?action=forms |
| Disallow | *?filter* |
| Disallow | *filter%26aspect* |
| Disallow | *All%20Items%26aspect* |
| Disallow | /search?q* |
| Disallow | *refine%3D* |
| Disallow | *sort%3D* |
| Disallow | /productimages/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.davidjones.com/sitemap.xml |
| sitemap | https://www.davidjones.com/pdp-sitemap.xml |
| sitemap | https://www.davidjones.com/blog/sitemap.xml |
Comments