maritime-executive.com
robots.txt
Robots Exclusion Standard data for maritime-executive.com
Resource Scan
Scan Details
| Site Domain | maritime-executive.com |
| Base Domain | maritime-executive.com |
| Scan Status | Ok |
| Last Scan | 2024-10-30T09:54:19+00:00 |
| Next Scan | 2024-11-06T09:54:19+00:00 |
Last Scan
| Scanned | 2024-10-30T09:54:19+00:00 |
| URL | https://maritime-executive.com/robots.txt |
| Domain IPs | 172.66.40.80, 172.66.43.176, 2606:4700:3108::ac42:2850, 2606:4700:3108::ac42:2bb0 |
| Response IP | 172.66.40.80 |
| Found | Yes |
| Hash | 6cdfa422793be85019ee83b7c90cf5a032386b72f0ce04e902635a211a605ee0 |
| SimHash | e9255856e1d3 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /libs/ |
| Disallow | /packages/ |
| Disallow | /vendor/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://maritime-executive.com/sitemap.xml |
| sitemap | https://maritime-executive.com/news.xml |