cdn.searchspring.net
robots.txt
Robots Exclusion Standard data for cdn.searchspring.net
Resource Scan
Scan Details
| Site Domain | cdn.searchspring.net |
| Base Domain | searchspring.net |
| Scan Status | Ok |
| Last Scan | 2024-06-14T07:47:29+00:00 |
| Next Scan | 2024-07-14T07:47:29+00:00 |
Last Scan
| Scanned | 2024-06-14T07:47:29+00:00 |
| URL | https://cdn.searchspring.net/robots.txt |
| Domain IPs | 13.35.18.16, 13.35.18.2, 13.35.18.45, 13.35.18.52 |
| Response IP | 13.35.18.2 |
| Found | Yes |
| Hash | 929c3f58319f747ad1fd6e93bb8b130658ceeb83e2c2c36cf7f7c5772e32d936 |
| SimHash | 5d14d852e710 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /angular_search/ |
| Allow | /search/ |
| Allow | /ajax_search/ |
| Allow | /autocomplete/autocomplete.css |
| Allow | /autocomplete/autocomplete-v2.css |
| Allow | /autocomplete/searchspring-autocomplete.min.js |
| Allow | /widgets.js |
| Allow | /widgets/ |
| Allow | /sandbox/culinary-test.html |
| Disallow | / |
| Disallow | /search/v3.50.1-nocrawl/js/searchspring.catalog.js |
| Disallow | /ajax_search/js/searchspring-catalog.min.js?nocrawl=1 |