salescloser.ai
robots.txt

Robots Exclusion Standard data for salescloser.ai

Resource Scan

Scan Details

Site Domain salescloser.ai
Base Domain salescloser.ai
Scan Status Ok
Last Scan2025-08-21T23:25:16+00:00
Next Scan 2025-09-20T23:25:16+00:00

Last Scan

Scanned2025-08-21T23:25:16+00:00
URL https://salescloser.ai/robots.txt
Domain IPs 104.26.12.190, 104.26.13.190, 172.67.70.158, 2606:4700:20::681a:cbe, 2606:4700:20::681a:dbe, 2606:4700:20::ac43:469e
Response IP 104.26.13.190
Found Yes
Hash 464b059698cea648fa9016a3a55b0285c30eaba08c216f34c030c61b13df0a4c
SimHash 6fa1d0008c90

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /demo-confirmed/
Disallow /thank-you/
Disallow /services/
Disallow /layouts/
Disallow /portfolio/
Disallow /team/
Disallow /category/
Disallow /services_group/
Disallow /author/
Disallow /producthunt
Disallow /startcall
Disallow /sales-closer-ai-homepage-2
Disallow /drive-deals
Disallow /real-state
Disallow /thank-you-page
Disallow /start-demo
Disallow /sales-closer-ai-homepage/contact-us
Disallow /healthcare
Disallow /subscribe
Disallow /start-call-test
Disallow /sw-draft
Disallow /car-dealership
Disallow /cars
Disallow /startnow
Disallow /signup-ad
Disallow /login
Disallow /register?*
Disallow /password/
Disallow /agents/
Disallow /video-grid-test
Disallow /sales-closer-quiz-ver-02
Disallow /start-now
Disallow /sales-closer-ai-edits
Disallow /sales-closer-quiz
Disallow /tag/
Disallow /sc-sales/
Disallow /writer/
Disallow /?*
Disallow /cdn-cgi/l/email-protection
Disallow /ai-agents-aid-india/
Disallow /ai-agents-aid-au/
Disallow /in-ai-agents/
Disallow /ai-agents-aid/
Disallow /ai-agents-aid-latam/
Disallow /ai_sales_team/
Disallow /ai-agents/
Disallow /launch-your-ai-sales-agent/
Disallow /ai-agents-aid-europe/
Disallow /ai-agents-latam/
Disallow /ai-agents-demo-portuguese/

chatgpt-user
chatgpt-user/1.0
chatgpt-user/2.0
gptbot
gptbot/1.1
oai-searchbot
oai-searchbot/1.0

Rule Path
Allow /

amazonbot

Rule Path
Allow /

claudebot
claude-web
claude-web/1.0
claudebot/1.0
claude-user
claude-searchbot

Rule Path
Allow /

applebot
applebot-extended

Rule Path
Allow /

ccbot
ccbot/1.0

Rule Path
Allow /

chatgpt-user
chatgpt-user/2.0
gptbot
oai-searchbot

Rule Path
Allow /

cohere-ai
cohere-ai/1.0

Rule Path
Allow /

duckassistbot
duckassistbot/1.0

Rule Path
Allow /

facebookbot
meta-externalagent
meta-externalagent
metabot

Rule Path
Allow /

google-cloudvertexbot
google-extended
google-extended/1.0
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Allow /

perplexitybot
perplexity-user/1.0

Rule Path
Allow /

quora-bot

Rule Path
Allow /

bingbot
bingchat

Rule Path
Allow /

ai2bot/1.0

Rule Path
Allow /

diffbot/0.1

Rule Path
Allow /

youbot

Rule Path
Allow /

mistralai-user/1.0

Rule Path
Allow /

copilotbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://salescloser.ai/sitemap_index.xml

Comments

  • ChatGPT / OpenAI
  • Amazon
  • Anthropic
  • Apple
  • CCBot
  • ChatGPT / OpenAI
  • Cohere
  • DuckDuckGo
  • Facebook / Meta
  • Google
  • Perplexity
  • Quora
  • Microsoft / Bing
  • AI2 / Allen Institute
  • Diffbot
  • You.com
  • Mistral AI
  • GitHub Copilot / Microsoft