drishtiias.com
robots.txt
Robots Exclusion Standard data for drishtiias.com
Resource Scan
Scan Details
| Site Domain | drishtiias.com |
| Base Domain | drishtiias.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T06:20:52+00:00 |
| Next Scan | 2024-11-16T06:20:52+00:00 |
Last Scan
| Scanned | 2024-11-09T06:20:52+00:00 |
| URL | https://drishtiias.com/robots.txt |
| Redirect | https://www.drishtiias.com/robots.txt |
| Redirect Domain | www.drishtiias.com |
| Redirect Base | drishtiias.com |
| Domain IPs | 104.26.12.107, 104.26.13.107, 172.67.75.51, 2606:4700:20::681a:c6b, 2606:4700:20::681a:d6b, 2606:4700:20::ac43:4b33 |
| Redirect IPs | 104.26.12.107, 104.26.13.107, 172.67.75.51, 2606:4700:20::681a:c6b, 2606:4700:20::681a:d6b, 2606:4700:20::ac43:4b33 |
| Response IP | 104.26.12.107 |
| Found | Yes |
| Hash | 60a7ae97da08c6cf573a9ad3bc8e4f3070415457bd782c9f1ce198ed8681ded1 |
| SimHash | 491d9833ebd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /be-mains-ready-daily-answer-writing-practice-question-test |
| Disallow | /post-ticket |
| Disallow | /be-mains-ready-daily-answer-writing-practice-question-test/* |
| Disallow | /post-ticket/* |
| Disallow | /store/* |
| Disallow | /hindi-down/* |
| Disallow | /mobile/* |
| Disallow | /ethics-online-course-english-medium-registration-confirmation |
| Disallow | /hindi/online-pendrive-courses/ras-rts-prelims-course-2021 |
| Disallow | /search/* |
| Disallow | /hindi/search/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /hindi/pendrive-course/online-pendrive-course |
| Disallow | /images/admitcards/* |
| Disallow | /hindi/online-pendrive-courses/gs-foundation-classes |
| Disallow | /ethics-online-course-english-medium-registration-confirmation |
| Disallow | /hindi/online-pendrive-courses/ras-rts-prelims-course-2021 |
| Disallow | /open-mock-test-prelims-2021 |
| Disallow | /search/* |
| Disallow | /hindi/search/* |
Warnings
- 1 invalid line.