Log In Sign Up

boatcoversdirect.com
robots.txt

Robots Exclusion Standard data for boatcoversdirect.com

Resource Scan

Scan Details

Site Domain boatcoversdirect.com
Base Domain boatcoversdirect.com
Scan Status Ok
Last Scan2024-10-06T06:50:02+00:00
Next Scan 2024-11-05T06:50:02+00:00

Last Scan

Scanned2024-10-06T06:50:02+00:00
URL https://boatcoversdirect.com/robots.txt
Redirect https://www.boatcoversdirect.com/robots.txt
Redirect Domain www.boatcoversdirect.com
Redirect Base boatcoversdirect.com
Domain IPs 3.22.143.49, 3.23.71.175
Redirect IPs 3.22.143.49, 3.23.71.175
Response IP 3.22.143.49
Found Yes
Hash 8def19315530ff733e2a0b5e50349a17f7725f74787974bada75b826fd243d6e
SimHash d04057567e00

Groups

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

domainappender

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

image.coccoc

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

proximic

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

expanse

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

internet-measurement

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

wp_is_mobile

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

java

Rule Path
Disallow /

mozlila

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

foregenix

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /boat-lovers/wp-includes
Disallow /boat-lovers/wp-content/plugins
Disallow /boat-lovers/wp-content/cache
Disallow /boat-lovers/wp-content/themes
Disallow /boat-lovers/trackback
Disallow /boat-lovers/comments
Disallow /boat-lovers/*/trackback
Disallow /boat-lovers/*/comments
Back to top

Other Records

Field Value
sitemap https://www.boatcoversdirect.com/boat-lovers/sitemap_index.xml
sitemap https://www.boatcoversdirect.com/sitemapxml/sitemapindex.php
Back to top

Comments

  • Blog
Back to top

Warnings

  • 4 invalid lines.
Back to top