indian-express.com
robots.txt
Robots Exclusion Standard data for indian-express.com
Resource Scan
Scan Details
| Site Domain | indian-express.com |
| Base Domain | indian-express.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-02T13:28:23+00:00 |
| Next Scan | 2024-07-01T13:28:23+00:00 |
Last Successful Scan
| Scanned | 2021-10-06T01:37:27+00:00 |
| URL | http://indian-express.com/robots.txt |
| Redirect | https://indianexpress.com/robots.txt |
| Redirect Domain | indianexpress.com |
| Redirect Base | indianexpress.com |
| Found | Yes |
| Hash | d2208055f26e41f066ff04b17f65eb366ea9c8091e2996dd29f412d6e2dfcf64 |
| SimHash | ba1189638608 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /1050432/ |
| Disallow | /dummy/ |
| Disallow | /homepage/ |
| Disallow | /prime-suspect/ |
| Disallow | /ie/daily/ |
| Disallow | /static-home-ad-template/ |
| Disallow | /static-article-ad-template/ |
| Disallow | /entertainment/wallpapers/ |
| Disallow | /entertainment/section/Television/617/ |
| Disallow | /entertainment/old/screenawards08/best-editing.html |
| Disallow | /entertainment/fullstory.php |
| Disallow | /citiesfullstory.php |
| Disallow | /citiesarticle/ |
| Disallow | /interstitial/ |
| Disallow | /Blog-IE/ |
| Disallow | /ajax/ |
| Disallow | /ramnath-goenka-foundation/dump |
| Disallow | /entertainment/old/ |
| Disallow | /citiesfullstory.php?newsid=* |
| Disallow | /inner_video.php?videoId=* |
| Disallow | /storyOld.php?storyId=* |
| Disallow | /entertainment/old/fullstory.php?content_id=* |
| Disallow | /entertainment/old/* |
| Disallow | /comments_print.php?content_id=* |
| Disallow | /search/* |
| Disallow | /comments/* |
| Disallow | /*?s |
| Disallow | /*?newsid |
| Disallow | /quote/* |
| Disallow | /openinappbtn/* |
| Disallow | /apple-app-site-association |
| Disallow | /login/* |
| Disallow | /registration/* |
| Disallow | /subscribe/ |
| Disallow | /my-account/ |
| Disallow | /reset-password/ |
| Disallow | /forgot-password/ |
| Disallow | /change-password/ |
| Disallow | /subscriptions/ |
| Disallow | /my-subscriptions/ |
| Disallow | /purchase/ |
| Disallow | /thank-you/ |
| Disallow | /my-premium/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://indianexpress.com/news-sitemap.xml |
| sitemap | https://indianexpress.com/image-sitemap.xml |
| sitemap | https://indianexpress.com/video-sitemap.xml |
| sitemap | https://indianexpress.com/category-sitemap.xml |
| sitemap | https://indianexpress.com/allsitemap.xml |
| sitemap | https://indianexpress.com/aboutsitemapindex.xml |
| sitemap | https://indianexpress.com/sitemap.xml |
Comments