techcircle.vccircle.com
robots.txt

Robots Exclusion Standard data for techcircle.vccircle.com

Resource Scan

Scan Details

Site Domain techcircle.vccircle.com
Base Domain vccircle.com
Scan Status Ok
Last Scan3/14/2025, 6:57:09 AM
Next Scan 4/13/2025, 6:57:09 AM

Last Scan

Scanned3/14/2025, 6:57:09 AM
URL https://techcircle.vccircle.com/robots.txt
Redirect https://www.techcircle.in/robots.txt
Redirect Domain www.techcircle.in
Redirect Base techcircle.in
Domain IPs 13.234.155.246, 3.109.111.239
Redirect IPs 108.157.254.11, 108.157.254.22, 108.157.254.34, 108.157.254.65
Response IP 108.157.254.65
Found Yes
Hash 77ed79395990815742ee18d2fbcdfc0e68d881325f3959742a4ec96108386508
SimHash 2dfe5e763bb1

Groups

*

Rule Path
Disallow /application/
Disallow /public/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /opcache/
Disallow /assets/
Disallow /README.md
Disallow /contributing.md
Disallow /composer.json
Disallow /*.php$
Disallow /*.txt$
Disallow /*.log$
Disallow /*.rst$
Disallow /*.md$
Disallow /feeds/factiva/
Disallow /feeds/factiva/*
Disallow /v2/
Disallow /removed-files/
Disallow /rj-corp/
Disallow /generate-header/
Disallow /page/30/?sscriptalert
Disallow /page/blog-single.html
Disallow /welcome/load_more
Disallow /twitter.html
Disallow /opcache/*
Allow /application/controllers/
Allow /application/views/
Allow /tag/*
Allow /company/*

Other Records

Field Value
sitemap https://www.techcircle.in/sitemap/article-sitemap.xml
sitemap https://www.techcircle.in/sitemap/category-sitemap.xml
sitemap https://www.techcircle.in/sitemap/image-sitemap.xml
sitemap https://www.techcircle.in/sitemap/news-sitemap.xml
sitemap https://www.techcircle.in/sitemap/tag-sitemap.xml

Comments

  • Crawl-Delay: 20