Log In Sign Up

capndcharters.com
robots.txt

Robots Exclusion Standard data for capndcharters.com

Resource Scan

Scan Details

Site Domain capndcharters.com
Base Domain capndcharters.com
Scan Status Ok
Last Scan2025-10-28T21:14:04+00:00
Next Scan 2025-11-27T21:14:04+00:00

Last Scan

Scanned2025-10-28T21:14:04+00:00
URL https://capndcharters.com/robots.txt
Domain IPs 104.21.73.121, 172.67.162.73, 2606:4700:3032::ac43:a249, 2606:4700:3037::6815:4979
Response IP 172.67.162.73
Found Yes
Hash cbc1932ab54704432085f5bb1656ee4c227a0afc7ed47ec89298c5df276cc145
SimHash da16566a3e0a

Groups

baiduspider

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

sitelockspider

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

pycurl

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://capndcharters.com/sitemap.xml
Back to top