mujtahidacademy.com
robots.txt
Robots Exclusion Standard data for mujtahidacademy.com
Resource Scan
Scan Details
| Site Domain | mujtahidacademy.com |
| Base Domain | mujtahidacademy.com |
| Scan Status | Ok |
| Last Scan | 2026-01-06T11:53:52+00:00 |
| Next Scan | 2026-01-13T11:53:52+00:00 |
Last Scan
| Scanned | 2026-01-06T11:53:52+00:00 |
| URL | https://mujtahidacademy.com/robots.txt |
| Domain IPs | 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153 |
| Response IP | 185.199.110.153 |
| Found | Yes |
| Hash | c503bf1e261a23242295af590dcd1dce0ac0324ddcaae8d0239fb33bc951f102 |
| SimHash | 4319c81367b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /simulator/* |
| Allow | /mock-tests/* |
| Allow | /free-practice/* |
| Allow | /sample-questions/* |
| Allow | /practice-bank/* |
| Allow | /qudrat.html |
| Allow | /tahsili.html |
| Allow | /step.html |
| Allow | /cognitive.html |
| Allow | /university.html |
| Allow | /privacy-policy.html |
| Allow | /terms.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /simulator/* |
| Allow | /mock-tests/* |
| Allow | /free-practice/* |
| Allow | /sample-questions/* |
| Allow | /practice-bank/* |
| Allow | /qudrat.html |
| Allow | /tahsili.html |
| Allow | /step.html |
| Allow | /cognitive.html |
| Allow | /university.html |
| Allow | /privacy-policy.html |
| Allow | /terms.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandexbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /simulator/* |
| Allow | /mock-tests/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /private/ |
| Disallow | /temp/ |
| Disallow | /404.html |
| Disallow | /500.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mujtahidacademy.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments