findacrew.com
robots.txt
Robots Exclusion Standard data for findacrew.com
Resource Scan
Scan Details
| Site Domain | findacrew.com |
| Base Domain | findacrew.com |
| Scan Status | Ok |
| Last Scan | 2025-08-25T16:37:30+00:00 |
| Next Scan | 2025-09-08T16:37:30+00:00 |
Last Scan
| Scanned | 2025-08-25T16:37:30+00:00 |
| URL | https://findacrew.com/robots.txt |
| Domain IPs | 104.21.15.180, 172.67.163.190, 2606:4700:3032::ac43:a3be, 2606:4700:3035::6815:fb4 |
| Response IP | 172.67.163.190 |
| Found | Yes |
| Hash | 5472421c5cd1ba9dfe0fd5e85f9228b13e318c9728a4dd7bc081b5e4586ae108 |
| SimHash | 61bced467b23 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /crew/ |
| Disallow | /boat/ |
| Disallow | /en/crew/ |
| Disallow | /en/boat/ |
| Disallow | /it/equipaggio/ |
| Disallow | /it/imbarco/ |
| Disallow | /index |
| Allow | /crew/search |
| Allow | /boat/search |
| Allow | /en/crew/search |
| Allow | /en/boat/search |
| Allow | /it/equipaggio/ricerca |
| Allow | /it/imbarco/ricerca |
googlebot
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /index |
| Allow | /crew/ |
| Allow | /boat/ |
| Allow | /en/crew/ |
| Allow | /en/boat/ |
| Allow | /it/equipaggio/ |
| Allow | /it/imbarco/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /public/ |
| Disallow | /plugins/ |
| Disallow | /lib/ |
| Disallow | /templates/ |
| Disallow | /secure-server/ |
| Disallow | /images/ |
| Disallow | /adm/ |
| Disallow | /en/adm/ |
| Disallow | /it/adm/ |
| Disallow | /fac-adm/ |
| Disallow | /lan/ |
| Disallow | /crew/ |
| Disallow | /boat/ |
| Disallow | /en/crew/ |
| Disallow | /en/boat/ |
| Disallow | /it/equipaggio/ |
| Disallow | /it/imbarco/ |
| Disallow | /index |
| Disallow | /crew/search |
| Disallow | /boat/search |
| Disallow | /en/crew/search |
| Disallow | /en/boat/search |
| Disallow | /it/equipaggio/ricerca |
| Disallow | /it/imbarco/ricerca |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.findacrew.com/sitemap.xml |
Warnings
- 1 invalid line.
- `clean-param` is not a known field.