magicport.ai
robots.txt
Robots Exclusion Standard data for magicport.ai
Resource Scan
Scan Details
| Site Domain | magicport.ai |
| Base Domain | magicport.ai |
| Scan Status | Ok |
| Last Scan | 2025-08-21T14:32:53+00:00 |
| Next Scan | 2025-09-20T14:32:53+00:00 |
Last Scan
| Scanned | 2025-08-21T14:32:53+00:00 |
| URL | https://magicport.ai/robots.txt |
| Domain IPs | 104.26.0.241, 104.26.1.241, 172.67.69.243, 2606:4700:20::681a:1f1, 2606:4700:20::681a:f1, 2606:4700:20::ac43:45f3 |
| Response IP | 104.26.0.241 |
| Found | Yes |
| Hash | af51c5620d70d50e05057707f5b6d11f2acf161b57d48e0dd4cff01450e880bf |
| SimHash | 4d2151348155 |
Groups
googlebot
yandexbot
bingbot
slurp
duckduckbot
baiduspider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /company/request/* |
| Disallow | /vessels/load/* |
| Disallow | /*build_by |
| Disallow | /*port_ids |
| Disallow | /*min_eta |
| Disallow | /*max_eta |
| Disallow | /*exclude_flags |
| Disallow | /*include_flags |
| Disallow | /*built_year_ |
| Disallow | /*gross_tonnage_ |
| Disallow | /*dwt_start |
| Disallow | /*dwt_end |
| Disallow | /*teu_ |
| Disallow | /*net_tonnage_ |
| Disallow | /*loa_start |
| Disallow | /*loa_end |
| Disallow | /*role%3D |
| Disallow | /*fleet_size_ |
| Disallow | /*_draft%3D |
| Disallow | /*_width%3D |
| Disallow | /*_length%3D |
| Disallow | /*ship_types%3D |
| Disallow | /*types%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /company/request/* |
| Disallow | /vessels/load/* |
| Disallow | /*build_by |
| Disallow | /*port_ids |
| Disallow | /*min_eta |
| Disallow | /*max_eta |
| Disallow | /*exclude_flags |
| Disallow | /*include_flags |
| Disallow | /*built_year_ |
| Disallow | /*gross_tonnage_ |
| Disallow | /*dwt_start |
| Disallow | /*dwt_end |
| Disallow | /*teu_ |
| Disallow | /*net_tonnage_ |
| Disallow | /*loa_start |
| Disallow | /*loa_end |
| Disallow | /*role%3D |
| Disallow | /*fleet_size_ |
| Disallow | /*_draft%3D |
| Disallow | /*_width%3D |
| Disallow | /*_length%3D |
| Disallow | /*ship_types%3D |
| Disallow | /*types%3D |