maersk.com
robots.txt
Robots Exclusion Standard data for maersk.com
Resource Scan
Scan Details
| Site Domain | maersk.com |
| Base Domain | maersk.com |
| Scan Status | Ok |
| Last Scan | 2024-06-19T04:00:43+00:00 |
| Next Scan | 2024-07-03T04:00:43+00:00 |
Last Scan
| Scanned | 2024-06-19T04:00:43+00:00 |
| URL | https://maersk.com/robots.txt |
| Redirect | https://www.maersk.com/robots.txt |
| Redirect Domain | www.maersk.com |
| Redirect Base | maersk.com |
| Domain IPs | 23.52.40.51, 23.52.40.59 |
| Redirect IPs | 23.32.29.17, 96.17.180.49 |
| Response IP | 96.17.180.49 |
| Found | Yes |
| Hash | ea337f936cdd16187ece06933d93dd0df983e8d95fd96bc632e03572b1b7ac0f |
| SimHash | 418cc87c9013 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /tracking/$ |
| Allow | /tracking/air/$ |
| Allow | /tracking/assets/ |
| Allow | /tracking/lcl/$ |
| Disallow | /careers/vacancies/ |
| Disallow | /schedules/*%3D |
| Disallow | /search*%3D |
| Disallow | /share-via |
| Disallow | /tracking/* |
| Disallow | /vacancies/ |
*
| Rule | Path |
|---|---|
| Allow | /*-*/careers/technology |
| Allow | /insights/filter$ |
| Allow | /logistics-explained/filter$ |
| Allow | /onlinequote/$ |
| Allow | /onlinequote/assets/ |
| Allow | /portaluser/login$ |
| Allow | /portaluser/register$ |
| Allow | /tracking/$ |
| Allow | /tracking/air/$ |
| Allow | /tracking/assets/ |
| Allow | /tracking/lcl/$ |
| Disallow | /*-*/about/our-history |
| Disallow | /*-*/beta |
| Disallow | /*-*/brexit |
| Disallow | /*-*/careers |
| Disallow | /*-*/growth |
| Disallow | /*-*/insights/tags/ |
| Disallow | /*-*/live-events |
| Disallow | /*-*/onlinequote |
| Disallow | /*-*/portaluser |
| Disallow | /*-*/procurement-academy |
| Disallow | /*-*/schedules |
| Disallow | /*-*/search |
| Disallow | /*-*/share-via |
| Disallow | /*-*/support/case |
| Disallow | /*-*/support/chat |
| Disallow | /*-*/tracking |
| Disallow | /*-*/website-status |
| Disallow | /*.doc |
| Disallow | /*.ppt |
| Disallow | /*.xls |
| Disallow | /*/filter |
| Disallow | /*cHash%3D |
| Disallow | /*elqTrackId%3D |
| Disallow | /*exit%3D |
| Disallow | /*link.aspx_id%3D |
| Disallow | /*locationId%3D |
| Disallow | /*originalUrl%3D |
| Disallow | /*tx_ |
| Disallow | /*url%3D |
| Disallow | /about/cfs |
| Disallow | /about/do-copy |
| Disallow | /about/edo |
| Disallow | /acm/ |
| Disallow | /akam/ |
| Disallow | /allocations |
| Disallow | /beta |
| Disallow | /billoflading |
| Disallow | /book |
| Disallow | /captcha |
| Disallow | /careers/vacancies? |
| Disallow | /cargo-insurance |
| Disallow | /commodity/ |
| Disallow | /common/ |
| Disallow | /dashboard |
| Disallow | /demurrage |
| Disallow | /doLogin |
| Disallow | /dqcs |
| Disallow | /en/careers |
| Disallow | /es-ES |
| Disallow | /essential/location |
| Disallow | /fixedSpotBooking |
| Disallow | /flow/ |
| Disallow | /forms/ |
| Disallow | /go$ |
| Disallow | /hub |
| Disallow | /ibooking |
| Disallow | /ign/ |
| Disallow | /inlandpricelookup |
| Disallow | /instantPrice |
| Disallow | /intermodal/ |
| Disallow | /lcl |
| Disallow | /liveEngage |
| Disallow | /loggedin |
| Disallow | /logistics-explained/tags/ |
| Disallow | /Maersk/Home/ |
| Disallow | /multilanguageapp/ |
| Disallow | /my-customs |
| Disallow | /myfinance |
| Disallow | /mymaersk |
| Disallow | /news/category/*? |
| Disallow | /news/category/planned-maintenance |
| Disallow | /news/category/website-enhancement |
| Disallow | /nl-NL |
| Disallow | /onlinequote/* |
| Disallow | /payer |
| Disallow | /ping |
| Disallow | /portallang |
| Disallow | /portaluser |
| Disallow | /pt-pt |
| Disallow | /pt-PT |
| Disallow | /ratelookup/ |
| Disallow | /ru-ru/local-information |
| Disallow | /ru-ru/transportation-services/air-freight |
| Disallow | /rules-lookup/ |
| Disallow | /schedules/*%3D |
| Disallow | /scp/ |
| Disallow | /search*%3D |
| Disallow | /security/ |
| Disallow | /share-via |
| Disallow | /shipment |
| Disallow | /shipping |
| Disallow | /sitecore |
| Disallow | /subscriptions/ |
| Disallow | /support/chat/? |
| Disallow | /tasks/ |
| Disallow | /tracking/* |
| Disallow | /user/ |
| Disallow | /vacancies/ |
| Disallow | /vessels |
| Disallow | /web/ |
| Disallow | /webuser |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.maersk.com/sitemap.xml |
| sitemap | https://www.maersk.com/sitemap-cs.xml |
| sitemap | https://www.maersk.com/sitemap-is.xml |
Warnings
- `clean-param` is not a known field.
Comments