shopless.co.nz
robots.txt
Robots Exclusion Standard data for shopless.co.nz
Resource Scan
Scan Details
| Site Domain | shopless.co.nz |
| Base Domain | shopless.co.nz |
| Scan Status | Ok |
| Last Scan | 2024-09-01T03:50:12+00:00 |
| Next Scan | 2024-10-01T03:50:12+00:00 |
Last Scan
| Scanned | 2024-09-01T03:50:12+00:00 |
| URL | https://shopless.co.nz/robots.txt |
| Redirect | https://www.talents.kiwi/robots.txt |
| Redirect Domain | www.talents.kiwi |
| Redirect Base | talents.kiwi |
| Domain IPs | 18.155.68.28, 18.155.68.29, 18.155.68.41, 18.155.68.71 |
| Redirect IPs | 3.165.102.111, 3.165.102.51, 3.165.102.90, 3.165.102.94 |
| Response IP | 3.165.102.94 |
| Found | Yes |
| Hash | fa5cd78556af7b01702c543ca8482018e1da456dcfe2b7d21e64f8c527f52af6 |
| SimHash | 2f51e836a9b2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /browse?*sort=* |
| Disallow | /browse?*distance=* |
| Disallow | /browse?*price=* |
| Disallow | /browse?*car.*=* |
| Disallow | /browse?*job.=* |
| Disallow | /browse?*property.*=* |
| Disallow | /browse?*house-rental.*=* |
| Disallow | /*/post-ad/* |
| Disallow | /manage/* |
| Disallow | /ads/* |
| Disallow | /shopping/* |
| Disallow | /admin/* |
| Disallow | /account/confirm-email* |
| Disallow | /account/confirm-email* |
| Disallow | /account/login?ReturnUrl=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.talents.kiwi/sitemap/sitemap.xml |