vccircle.com
robots.txt

Robots Exclusion Standard data for vccircle.com

Resource Scan

Scan Details

Site Domain vccircle.com
Base Domain vccircle.com
Scan Status Ok
Last Scan2025-10-19T18:57:09+00:00
Next Scan 2025-11-02T18:57:09+00:00

Last Scan

Scanned2025-10-19T18:57:09+00:00
URL https://vccircle.com/robots.txt
Redirect https://www.vccircle.com/robots.txt
Redirect Domain www.vccircle.com
Redirect Base vccircle.com
Domain IPs 3.165.102.3, 3.165.102.34, 3.165.102.54, 3.165.102.6
Redirect IPs 2600:9000:2721:3800:16:226f:8b00:93a1, 2600:9000:2721:4800:16:226f:8b00:93a1, 2600:9000:2721:8000:16:226f:8b00:93a1, 2600:9000:2721:a800:16:226f:8b00:93a1, 2600:9000:2721:b600:16:226f:8b00:93a1, 2600:9000:2721:c800:16:226f:8b00:93a1, 2600:9000:2721:cc00:16:226f:8b00:93a1, 2600:9000:2721:ea00:16:226f:8b00:93a1, 3.165.102.3, 3.165.102.34, 3.165.102.54, 3.165.102.6
Response IP 3.165.102.54
Found Yes
Hash bf124752ced757bd95131b777ab8c58f3986d8e7de2bb7bc1e368b09acc95e19
SimHash 357af87542db

Groups

amazonbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Allow /
Disallow /endpoint/
Disallow /endpoint/*
Disallow */industry/industry/
Disallow /application/
Disallow /public/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /opcache/
Disallow /README.md
Disallow /contributing.md
Disallow /composer.json
Disallow /*.php$
Disallow /*.txt$
Disallow /*.log$
Disallow /*.rst$
Disallow /*.md$
Disallow /news/2012/*
Disallow /wp-*
Disallow /author/*/feed
Disallow /tag/*/feed
Disallow /wp-content/*
Disallow /sites/default/*
Disallow /bizcircle/company/company_details/*
Disallow /industry/*/page/*/
Disallow /deal-type/*/page/*/
Disallow /wp-login.php?*
Disallow /sitemap.xml?*
Disallow /content/load_previous_content
Disallow /500/*
Disallow /2007/*
Disallow /2008/*
Disallow /2009/*
Disallow /2010/*
Disallow /2011/*
Disallow /2012/*
Disallow /2013/*
Disallow /2014/*
Disallow /2015/*
Disallow /2016/*
Disallow /2017/*
Disallow /2018/*
Disallow /work-with-us
Disallow /infracircle/*
Disallow /copyright
Disallow /wp-login.php?*
Disallow /feeds/htcatnewsfeed/*
Disallow /feeds/htnewsfeed/
Disallow /feeds/htnewsfeed/*
Disallow /tcfeeds/htcatnewsfeed/*
Disallow /tcfeeds/htnewsfeed/
Disallow /tcfeeds/htnewsfeed/*
Allow /ads.txt

Other Records

Field Value
sitemap https://www.vccircle.com/sitemap/news-sitemap.xml
sitemap https://www.vccircle.com/sitemap/article-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/video-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/tag-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/interview-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/industry-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/image-sitemap-index.xml
sitemap https://www.vccircle.com/sitemap/page-sitemap-index.xml

Comments

  • Allow all user agents.
  • Sitemap: https://www.vccircle.com/sitemap/article_type-sitemap.xml