insurancenavy.com
robots.txt

Robots Exclusion Standard data for insurancenavy.com

Resource Scan

Scan Details

Site Domain insurancenavy.com
Base Domain insurancenavy.com
Scan Status Ok
Last Scan2025-11-30T17:29:22+00:00
Next Scan 2025-12-07T17:29:22+00:00

Last Scan

Scanned2025-11-30T17:29:22+00:00
URL https://insurancenavy.com/robots.txt
Redirect https://www.insurancenavy.com/robots.txt
Redirect Domain www.insurancenavy.com
Redirect Base insurancenavy.com
Domain IPs 104.26.0.234, 104.26.1.234, 172.67.68.251, 2606:4700:20::681a:1ea, 2606:4700:20::681a:ea, 2606:4700:20::ac43:44fb
Redirect IPs 104.26.0.234, 104.26.1.234, 172.67.68.251, 2606:4700:20::681a:1ea, 2606:4700:20::681a:ea, 2606:4700:20::ac43:44fb
Response IP 104.26.1.234
Found Yes
Hash bbe0e0611544856cac53de720de4920f6a494743b81b9c7add8901370defb25f
SimHash 12187142ce84

Groups

oai-searchbot
chatgpt-user
chatgpt-user/2.0
gptbot
anthropic-ai
claudebot
claude-web
claude-user
claude-searchbot
perplexitybot
perplexity-user
google-extended
gemini-deep-research
google-cloudvertexbot
bingbot
amazonbot
applebot
applebot-extended
facebookbot
meta-externalagent
meta-externalfetcher
linkedinbot
bytespider
duckassistbot
cohere-ai
ai2bot
ccbot
diffbot
omgili
mistralai-user
timpibot
youbot

Rule Path
Disallow /autopay-cancel/
Disallow /autopay-enroll/
Disallow /autopay-success/
Disallow /auto-quote/
Disallow /cdn-cgi/zaraz/
Disallow /contact-error/
Disallow /contact-success/
Disallow /commercial-property-quote/
Disallow /commercial-auto-quote/
Disallow /es/autopay-cancel/
Disallow /es/autopay-enroll/
Disallow /es/autopay-success/
Disallow /es/auto-quote/
Disallow /es/commercial-auto-quote/
Disallow /es/contact-error/
Disallow /es/contact-success/
Disallow /es/file-a-claim-error/
Disallow /es/file-a-claim-success/
Disallow /es/quick-apply/
Disallow /es/payment-options/
Disallow /es/renew-options/
Disallow /es/start-payment/
Disallow /es/start-quote/
Disallow /es/start-renewal/
Disallow /es/thank-you/
Disallow /file-a-claim-error/
Disallow /file-a-claim-success/
Disallow /quick-apply/
Disallow /payment-options/
Disallow /renew-options/
Disallow /start-payment/
Disallow /start-quote/
Disallow /start-renewal/
Disallow /thank-you/

*

Rule Path
Disallow /autopay-cancel/
Disallow /autopay-enroll/
Disallow /autopay-success/
Disallow /auto-quote/
Disallow /cdn-cgi/zaraz/
Disallow /contact-error/
Disallow /contact-success/
Disallow /commercial-property-quote/
Disallow /commercial-auto-quote/
Disallow /es/autopay-cancel/
Disallow /es/autopay-enroll/
Disallow /es/autopay-success/
Disallow /es/auto-quote/
Disallow /es/commercial-auto-quote/
Disallow /es/contact-error/
Disallow /es/contact-success/
Disallow /es/file-a-claim-error/
Disallow /es/file-a-claim-success/
Disallow /es/quick-apply/
Disallow /es/payment-options/
Disallow /es/renew-options/
Disallow /es/start-payment/
Disallow /es/start-quote/
Disallow /es/start-renewal/
Disallow /es/thank-you/
Disallow /file-a-claim-error/
Disallow /file-a-claim-success/
Disallow /quick-apply/
Disallow /payment-options/
Disallow /renew-options/
Disallow /start-payment/
Disallow /start-quote/
Disallow /start-renewal/
Disallow /thank-you/

magpie-crawler
dotbot
mj12bot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
semrushbot-ocob
rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.insurancenavy.com/sitemap.xml