capecodxplore.com
robots.txt

Robots Exclusion Standard data for capecodxplore.com

Resource Scan

Scan Details

Site Domain capecodxplore.com
Base Domain capecodxplore.com
Scan Status Ok
Last Scan2024-09-28T15:22:21+00:00
Next Scan 2024-10-05T15:22:21+00:00

Last Scan

Scanned2024-09-28T15:22:21+00:00
URL https://capecodxplore.com/robots.txt
Domain IPs 18.117.61.222, 3.135.242.15, 3.23.164.107
Response IP 18.117.61.222
Found Yes
Hash f75da08fa1cd703bc7c7c5053144abb857bffed8ab626b7b0b1d39599b9b2fde
SimHash 0808d5c5ff90

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Disallow /blog/page/*
Disallow *?s=
Disallow /search/
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *?p=
Disallow /blog/*?s=
Disallow /category/
Disallow /login/
Disallow /*?_
Disallow /*?s=
Disallow /market-place/page/*
Disallow /?s=seashore
Disallow /page/*/?s=seashore
Disallow /wp-includes/ID3/
Disallow /wp-includes/ID3/readme.txt
Disallow /wp-includes/images/crystal/license.txt

semrushbot

Rule Path
Disallow /*?_
Disallow /market-place/page/*
Disallow /*?s=seashore
Disallow /page/*/?s=seashore

siteauditbot

Rule Path
Disallow /*?_

semrushbot-ba

Rule Path
Disallow /*?_

semrushbot-si

Rule Path
Disallow /*?_

semrushbot-swa

Rule Path
Disallow /*?_

semrushbot-ct

Rule Path
Disallow /*?_

splitsignalbot

Rule Path
Disallow /*?_

semrushbot-coub

Rule Path
Disallow /*?_

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://capecodxplore.com/sitemap_index.xml

Warnings

  • 1 invalid line.