crochetbits.com
robots.txt
Robots Exclusion Standard data for crochetbits.com
Resource Scan
Scan Details
| Site Domain | crochetbits.com |
| Base Domain | crochetbits.com |
| Scan Status | Ok |
| Last Scan | 2024-11-17T20:41:37+00:00 |
| Next Scan | 2024-11-24T20:41:37+00:00 |
Last Scan
| Scanned | 2024-11-17T20:41:37+00:00 |
| URL | https://crochetbits.com/robots.txt |
| Domain IPs | 104.26.6.205, 104.26.7.205, 172.67.70.19, 2606:4700:20::681a:6cd, 2606:4700:20::681a:7cd, 2606:4700:20::ac43:4613 |
| Response IP | 172.67.70.19 |
| Found | Yes |
| Hash | c83b6ee0c1950b166eef18308a55cc85d205b0ada0472c38b62c399d92eec96c |
| SimHash | a5138a652f94 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?orderby=* |
| Disallow | *?wordfence* |
| Disallow | *%26hid%3D* |
| Disallow | *?redirect_to=* |
| Disallow | *?preview_id=* |
| Disallow | */feed/$ |
| Disallow | *?p=* |
| Disallow | *?s=* |
| Disallow | *?wc-ajax=* |
| Disallow | */checkout/* |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | *?add-to-cart=* |
| Disallow | *?product_cat=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crochetbits.com/sitemap_index.xml |
Comments