findacrew.net
robots.txt
Robots Exclusion Standard data for findacrew.net
Resource Scan
Scan Details
| Site Domain | findacrew.net |
| Base Domain | findacrew.net |
| Scan Status | Ok |
| Last Scan | 2025-08-11T09:53:41+00:00 |
| Next Scan | 2025-08-25T09:53:41+00:00 |
Last Scan
| Scanned | 2025-08-11T09:53:41+00:00 |
| URL | https://findacrew.net/robots.txt |
| Redirect | https://www.findacrew.com/robots.txt |
| Redirect Domain | www.findacrew.com |
| Redirect Base | findacrew.com |
| Domain IPs | 104.21.87.43, 172.67.141.80, 2606:4700:3031::6815:572b, 2606:4700:3033::ac43:8d50 |
| Redirect IPs | 69.16.230.162 |
| Response IP | 69.16.230.162 |
| Found | Yes |
| Hash | 5472421c5cd1ba9dfe0fd5e85f9228b13e318c9728a4dd7bc081b5e4586ae108 |
| SimHash | 61bced467b23 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /crew/ |
| Disallow | /boat/ |
| Disallow | /en/crew/ |
| Disallow | /en/boat/ |
| Disallow | /it/equipaggio/ |
| Disallow | /it/imbarco/ |
| Disallow | /index |
| Allow | /crew/search |
| Allow | /boat/search |
| Allow | /en/crew/search |
| Allow | /en/boat/search |
| Allow | /it/equipaggio/ricerca |
| Allow | /it/imbarco/ricerca |
googlebot
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /index |
| Allow | /crew/ |
| Allow | /boat/ |
| Allow | /en/crew/ |
| Allow | /en/boat/ |
| Allow | /it/equipaggio/ |
| Allow | /it/imbarco/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /crew/ |
| Disallow | /boat/ |
| Disallow | /en/crew/ |
| Disallow | /en/boat/ |
| Disallow | /it/equipaggio/ |
| Disallow | /it/imbarco/ |
| Disallow | /index |
| Disallow | /crew/search |
| Disallow | /boat/search |
| Disallow | /en/crew/search |
| Disallow | /en/boat/search |
| Disallow | /it/equipaggio/ricerca |
| Disallow | /it/imbarco/ricerca |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.findacrew.com/sitemap.xml |
Warnings
- 1 invalid line.
- `clean-param` is not a known field.