sugotoys.com.au
robots.txt
Robots Exclusion Standard data for sugotoys.com.au
Resource Scan
Scan Details
| Site Domain | sugotoys.com.au |
| Base Domain | sugotoys.com.au |
| Scan Status | Ok |
| Last Scan | 2024-05-11T17:11:57+00:00 |
| Next Scan | 2024-06-10T17:11:57+00:00 |
Last Scan
| Scanned | 2024-05-11T17:11:57+00:00 |
| URL | https://sugotoys.com.au/robots.txt |
| Domain IPs | 172.66.40.242, 172.66.43.14, 2606:4700:3108::ac42:28f2, 2606:4700:3108::ac42:2b0e |
| Response IP | 172.66.40.242 |
| Found | Yes |
| Hash | bff71a69e69f133e7f2af913af62179585b4b1bd8b96b9da6bcee951fd7085e5 |
| SimHash | 801bc8b2ca13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*add-to-cart%3D* |
| Disallow | /cart/ |
| Disallow | /*add_to_wishlist%3D* |
| Disallow | /checkout/ |
| Disallow | /my-account/ |
| Disallow | /?blackhole |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |