techcircle.in
robots.txt
Robots Exclusion Standard data for techcircle.in
Resource Scan
Scan Details
| Site Domain | techcircle.in |
| Base Domain | techcircle.in |
| Scan Status | Ok |
| Last Scan | 2025-08-29T19:06:22+00:00 |
| Next Scan | 2025-09-05T19:06:22+00:00 |
Last Scan
| Scanned | 2025-08-29T19:06:22+00:00 |
| URL | https://techcircle.in/robots.txt |
| Redirect | https://www.techcircle.in/robots.txt |
| Redirect Domain | www.techcircle.in |
| Redirect Base | techcircle.in |
| Domain IPs | 108.157.254.11, 108.157.254.22, 108.157.254.34, 108.157.254.65 |
| Redirect IPs | 108.157.254.11, 108.157.254.22, 108.157.254.34, 108.157.254.65 |
| Response IP | 108.157.254.34 |
| Found | Yes |
| Hash | e9f76f21882b874ce367801130b66370418691de7a0fc7fd6852b1087da90742 |
| SimHash | 2d7ede702bb1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/ |
| Disallow | /public/ |
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /opcache/ |
| Disallow | /assets/ |
| Disallow | /README.md |
| Disallow | /contributing.md |
| Disallow | /composer.json |
| Disallow | /*.php$ |
| Disallow | /*.txt$ |
| Disallow | /*.log$ |
| Disallow | /*.rst$ |
| Disallow | /*.md$ |
| Disallow | /feeds/factiva/ |
| Disallow | /feeds/factiva/* |
| Disallow | /v2/ |
| Disallow | /removed-files/ |
| Disallow | /rj-corp/ |
| Disallow | /generate-header/ |
| Disallow | /page/30/?sscriptalert |
| Disallow | /page/blog-single.html |
| Disallow | /welcome/load_more |
| Disallow | /twitter.html |
| Disallow | /opcache/* |
| Allow | /application/controllers/ |
| Allow | /application/views/ |
| Allow | /tag/* |
| Allow | /company/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.techcircle.in/sitemap/article-sitemap.xml |
| sitemap | https://www.techcircle.in/sitemap/category-sitemap.xml |
| sitemap | https://www.techcircle.in/sitemap/image-sitemap.xml |
| sitemap | https://www.techcircle.in/sitemap/news-sitemap.xml |
| sitemap | https://www.techcircle.in/sitemap/tag-sitemap.xml |