merinews.com
robots.txt
Robots Exclusion Standard data for merinews.com
Resource Scan
Scan Details
| Site Domain | merinews.com |
| Base Domain | merinews.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-04-28T15:20:34+00:00 |
| Next Scan | 2024-07-27T15:20:34+00:00 |
Last Successful Scan
| Scanned | 2022-12-09T05:02:57+00:00 |
| URL | http://merinews.com/robots.txt |
| Domain IPs | 164.52.223.198 |
| Response IP | 164.52.223.198 |
| Found | Yes |
| Hash | c406c72f248904ba836cefa8833920fbab98617a3d98f20ba24060518de55cf5 |
| SimHash | 030124c665c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cms/ |
| Disallow | /cmsadmin/ |
| Disallow | /new/ |
| Disallow | /newversion/ |
| Disallow | /photosv2/ |
| Disallow | /mnc/jsp/cat2010/ |
| Disallow | /citizenJournalism/ |
| Disallow | /mnc/jsp/recentall2010/ |
| Disallow | /mnc/jsp/viewall2010/ |
| Disallow | /mnc/jsp/homepage2010/ |
| Disallow | /mnc/jsp/statichome/ |
| Disallow | /mypage/cjclub/jsp/CJList.jsp?q=new |
| Disallow | /health |
| Disallow | /education |
| Disallow | /travel |
| Disallow | /astrology |
| Disallow | /environment |
| Disallow | /women |
| Disallow | /interview |
| Disallow | /career |
| Disallow | /forgotPassword1 |
| Disallow | /changePassword1 |
| Disallow | /newLogin1 |
| Disallow | /mnc/jsp/viewallarticle2010/ |
| Disallow | /newArticleSearch |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.merinews.com/sitemap_news.xml |
| sitemap | http://www.merinews.com/sitemap.xml |
| sitemap | http://photos.merinews.com/sitemap/photogallery.xml |
Comments