stevesgoods.com
robots.txt
Robots Exclusion Standard data for stevesgoods.com
Resource Scan
Scan Details
| Site Domain | stevesgoods.com |
| Base Domain | stevesgoods.com |
| Scan Status | Ok |
| Last Scan | 2024-08-27T21:09:28+00:00 |
| Next Scan | 2024-09-26T21:09:28+00:00 |
Last Scan
| Scanned | 2024-08-27T21:09:28+00:00 |
| URL | https://stevesgoods.com/robots.txt |
| Domain IPs | 104.16.159.43, 104.17.9.99 |
| Response IP | 104.16.159.43 |
| Found | Yes |
| Hash | 57a551372fa002d348f2a73095b26423b94e864c13870825da2326b82aeb85cb |
| SimHash | a8155a01cde2 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | /wp-admin/admin-ajax.php | - |
| Allow | /wp-content/uploads/* | - |
| Allow | /wp-content/*.js | - |
| Allow | /wp-content/*.css | - |
| Allow | /wp-includes/*.js | - |
| Allow | /wp-includes/*.css | - |
| Disallow | /strippedCss/ | - |
| Disallow | /*?* | - |
| Disallow | /?lang=es | - |
| Disallow | /cgi-bin | - |
| Disallow | /cdn-cgi/ | - |
| Disallow | /*/attachment/ | - |
| Disallow | /tag/ | - |
| Allow | /page/ | - |
| Allow | /*/page/ | - |
| Allow | /*/*/page/ | - |
| Allow | /*/*/*/page/ | - |
| Disallow | /*/*/?add-to-cart=* | - |
| Disallow | /*/*/*/?add-to-cart=* | - |
| Disallow | /comments/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /?attachment_id* | - |
| Disallow | /author/ | - |
| Allow | /category/ | - |
| Disallow | /uncategorized/ | - |
| Disallow | /product-tag/ | - |
| Disallow | /checkout/ | - |
| Disallow | /privacy-policy/ | - |
| Disallow | /terms-and-conditions/ | - |
| Disallow | /my-account/ | - |
| Disallow | /etiqueta-producto/ | - |
| Disallow | /?page_id=* | - |
| Disallow | /*/?add-to-cart=* | - |
| Disallow | /*/image.svg | - |
| Disallow | /wholesale-registration-page/ | - |
| Disallow | /wholesale-log-in-page/ | - |
| Allow | /hemp-industry-blog/ | - |
| Disallow | / | / |
| Disallow | /?page_id=10748 | - |
| Disallow | /*/recommendation_icon.png | - |
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /search |
*
| Rule | Path |
|---|---|
| Disallow | /trackback |
| Disallow | /*trackback |
| Disallow | /*trackback* |
| Disallow | /*/trackback |
*
| Rule | Path |
|---|---|
| Allow | /feed/$ |
| Disallow | /feed/ |
| Disallow | /comments/feed/ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://stevesgoods.com/sitemap_index.xml |
Comments