yellow.co.nz
robots.txt
Robots Exclusion Standard data for yellow.co.nz
Resource Scan
Scan Details
| Site Domain | yellow.co.nz |
| Base Domain | yellow.co.nz |
| Scan Status | Ok |
| Last Scan | 2024-06-25T21:21:50+00:00 |
| Next Scan | 2024-07-02T21:21:50+00:00 |
Last Scan
| Scanned | 2024-06-25T21:21:50+00:00 |
| URL | https://yellow.co.nz/robots.txt |
| Domain IPs | 18.155.68.30, 18.155.68.77, 18.155.68.78, 18.155.68.9 |
| Response IP | 18.155.68.78 |
| Found | Yes |
| Hash | 7bf2d7e9fc90b12570b7890b43ed16ee31298cc523a0727dcb111a9fce72f54a |
| SimHash | 6f19d8024394 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /services/ |
| Disallow | /user/ |
| Disallow | reset/ |
| Disallow | listing/ |
| Disallow | review/ |
| Disallow | designs/ |
| Disallow | /*?_bc_fsnf=1* |
| Disallow | /*%26_bc_fsnf%3D1* |
bingbot
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /services/ |
| Disallow | /user/ |
| Disallow | /reset/ |
| Disallow | /listing/ |
| Disallow | /review/ |
| Disallow | /designs/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /account.php |
| Disallow | /cart.php |
| Disallow | /checkout.php |
| Disallow | /finishorder.php |
| Disallow | /login.php |
| Disallow | /orderstatus.php |
| Disallow | /postreview.php |
| Disallow | /productimage.php |
| Disallow | /productupdates.php |
| Disallow | /remote.php |
| Disallow | /search.php |
| Disallow | /viewfile.php |
| Disallow | /wishlist.php |
| Disallow | /admin/ |
| Disallow | /__socialshop/%20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://yellow.co.nz/sitemap.xml |
Warnings
- `host` is not a known field.