vesselfinder.com
robots.txt
Robots Exclusion Standard data for vesselfinder.com
Resource Scan
Scan Details
| Site Domain | vesselfinder.com |
| Base Domain | vesselfinder.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T00:08:41+00:00 |
| Next Scan | 2024-11-09T00:08:41+00:00 |
Last Scan
| Scanned | 2024-11-02T00:08:41+00:00 |
| URL | https://vesselfinder.com/robots.txt |
| Redirect | https://www.vesselfinder.com/robots.txt |
| Redirect Domain | www.vesselfinder.com |
| Redirect Base | vesselfinder.com |
| Domain IPs | 116.202.2.5, 159.69.101.70, 78.47.68.175, 88.99.127.255 |
| Redirect IPs | 116.202.2.5, 159.69.101.70, 78.47.68.175, 88.99.127.255 |
| Response IP | 78.47.68.175 |
| Found | Yes |
| Hash | 2aefd5a2f57891bdb33bc2ec08976bd6f951af5fc4538d9ed065691da09a3e00 |
| SimHash | 5c2496c4c199 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */vessels/view/* |
| Disallow | */ship-photos/* |
| Disallow | */vessels/captcha |
| Disallow | */vessels/uploadphoto/* |
| Disallow | */vessels/embedphoto |
| Disallow | */ports/uploadphoto/* |
| Disallow | */uploads/ship-photo/* |
| Disallow | */ports/captcha |
| Disallow | */site/login* |
| Disallow | */site/captcha |
| Disallow | */report-photo/* |
| Disallow | /embed |
| Disallow | /aismap* |
| Disallow | /testmap1 |
| Disallow | /testmap2 |
| Disallow | /vessels/details-test1/* |
| Disallow | /vessels/details-test2/* |
| Disallow | /publift/* |
| Disallow | /worker1/* |
| Disallow | /worker2/* |
| Disallow | */get-premium2 |
| Disallow | */satellite-ais2 |
| Disallow | */container-tracking-test |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vesselfinder.com/sitemap.xml |