mercurymarine.com
robots.txt
Robots Exclusion Standard data for mercurymarine.com
Resource Scan
Scan Details
| Site Domain | mercurymarine.com |
| Base Domain | mercurymarine.com |
| Scan Status | Ok |
| Last Scan | 2024-10-08T16:06:33+00:00 |
| Next Scan | 2024-11-07T16:06:33+00:00 |
Last Scan
| Scanned | 2024-10-08T16:06:33+00:00 |
| URL | https://mercurymarine.com/robots.txt |
| Redirect | https://www.mercurymarine.com/robots.txt |
| Redirect Domain | www.mercurymarine.com |
| Redirect Base | mercurymarine.com |
| Domain IPs | 150.136.196.252 |
| Redirect IPs | 104.18.43.241, 172.64.144.15, 2606:4700:4400::6812:2bf1, 2606:4700:4400::ac40:900f |
| Response IP | 172.64.144.15 |
| Found | Yes |
| Hash | e9aa7721fdce19c98fc497b44dbf0f9a841db18623dcc35a5a83b309ad3d3ed2 |
| SimHash | 7f15e704fa91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */search |
| Disallow | */product-search |
| Disallow | */search-results |
| Disallow | /*? |
| Disallow | */checkout |
| Disallow | */cart |
| Disallow | */my-account |
| Disallow | */compare |
| Disallow | */product/verado* |
| Disallow | */product/fourstroke* |
| Disallow | */product/pro-xs* |
| Disallow | */product/seapro* |
| Disallow | */product/6-2l* |
| Disallow | */product/62l* |
| Disallow | */product/8-2l* |
| Disallow | */product/avator* |
| Disallow | */product/jet* |
| Disallow | */product/alpha* |
| Disallow | */product/bravo* |
| Disallow | */product/mercury-diesel* |
| Disallow | */product/4-5l* |
| Disallow | */category/parts-accessories$ |
| Disallow | /cdn-cgi/ |
| Disallow | /content/ |
| Disallow | /content/mercury-marine/*.html |
| Allow | /content/*/mercury-marine/ |
| Allow | /content/mercury-marine/ |
rogerbot
dotbot
dataforseobot
mj12bot
ahrefsbot
semrushbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
semrushbot-sa
semrushbot-bm
amazonproductdiscoverybot
petalbot
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /cdn-cgi/ |
| Disallow | /content/ |
| Disallow | /content/mercury-marine/*.html |
| Allow | /content/*/mercury-marine/ |
| Allow | /content/mercury-marine/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mercurymarine.com/sitemap-index.xml |