newsmax.com
robots.txt
Robots Exclusion Standard data for newsmax.com
Resource Scan
Scan Details
| Site Domain | newsmax.com |
| Base Domain | newsmax.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-03-03T10:33:52+00:00 |
| Next Scan | 2024-06-01T10:33:52+00:00 |
Last Successful Scan
| Scanned | 2022-06-04T17:06:51+00:00 |
| URL | https://newsmax.com/robots.txt |
| Redirect | https://www.newsmax.com/robots.txt/ |
| Redirect Domain | www.newsmax.com |
| Redirect Base | newsmax.com |
| Response IP | 23.192.150.29 |
| Found | Yes |
| Hash | 1dbe088cefce2dd2eb77626d4770e3ebf2452d63cad18f78b1057ebe6101053a |
| SimHash | d188d0e9aa00 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /CMSPages/ |
| Allow | /CmsPages/newsmax/Handlers/ |
| Allow | /CMSScripts/ |
| Allow | /CMSscripts/ |
| Allow | /cmsscripts/ |
| Disallow | /CMSScripts/Newsmax/ |
| Disallow | /*.axd |
| Disallow | /*.axd$ |
| Disallow | /%0Aarchives/ |
| Disallow | /archives%20/ |
| Disallow | /ScriptResource.axd$ |
| Disallow | /ScriptResource.axd* |
| Disallow | /WebResource.axd$ |
| Disallow | /WebResource.axd* |
| Disallow | /bin/ |
| Disallow | /PrintTemplate.aspx |
| Disallow | /App_Themes/ |
| Disallow | /App_Themes/NewsmaxNew/images/Jokes/ |
| Disallow | /Draft/ |
| Disallow | /Draft-Stories/ |
| Disallow | /draft-stories/ |
| Disallow | /matt_towery/ |
| Disallow | /condivshillarybook/ |
| Disallow | /poll/ |
| Disallow | /ernest_istook/ |
| Disallow | /errorPage.html?aspxerrorpath=%2F |
| Disallow | /PatriciaPierce%20/ |
| Disallow | /PrintTemplate.aspx/ |
| Disallow | /ss/ |
| Disallow | /frank_gaffney/ |
| Disallow | /international.../ |
| Disallow | /David%20Limbaugh/ |
| Disallow | /borchgrave/ |
| Disallow | /inside_cover/ |
| Disallow | /gaffes/ |
| Disallow | /George/ |
| Disallow | /%21.hillary%21./ |
| Disallow | /savage/ |
| Disallow | /Peter/ |
| Disallow | /herbert_london/ |
| Disallow | /bill_oreilly/ |
| Disallow | /science/ |
| Disallow | /headline%20s/ |
| Disallow | /Ira/ |
| Disallow | /adv/ |
| Disallow | /Politic/ |
| Disallow | /jump/ |
| Disallow | /404?aspxerrorpath=%2F |
| Disallow | /insider_report/ |
| Disallow | /putnam/ |
| Disallow | /Bernard_Kerik/ |
| Disallow | /xml/ |
| Disallow | /uk/ |
| Disallow | /ne/ |
| Disallow | /rightwingturds/ |
| Disallow | /fontova/ |
| Disallow | /horowitz/ |
| Disallow | /pamela_geller/ |
| Disallow | /classifieds/ |
| Disallow | /john_perry/ |
| Disallow | /404?nfurl=http%3A%2F |
| Disallow | /forward_page/ |
| Disallow | /www/ |
| Disallow | /weyrich/ |
| Disallow | /headliness/ |
| Disallow | /404?aspxerrorpath%2F |
| Disallow | /100days/ |
| Disallow | /%20/ |
| Disallow | /s.e._cupp/ |
| Disallow | /indexk/ |
| Disallow | /PrintTemplate/ |
| Disallow | /hutchison/ |
| Disallow | /williams/ |
| Disallow | /Zipweather/ |
| Disallow | /wap/ |
| Disallow | /smith/ |
| Disallow | /barry_farber/ |
| Disallow | /LeBoutillier/ |
| Disallow | /election/ |
| Disallow | /n/ |
| Disallow | /p/ |
| Disallow | /christopher_ruddy/ |
| Disallow | /6305169/ |
| Disallow | /CMSMessages/ |
| Disallow | /cities/ |
| Disallow | /Personal/ |
| Disallow | /scripts/ |
| Disallow | /mediakit/ |
| Disallow | /gtc/ |
| Disallow | /medicine_men/ |
| Disallow | /lanny_davis/ |
| Disallow | /playvideo/ |
| Disallow | /alden/ |
| Disallow | /pages/optinpoll/ |
| Disallow | /pages/optin/ |
| Disallow | /t/error |
| Disallow | /t/error/ |
| Disallow | /dialogs/ |
| Disallow | /Dialogs/ |
| Disallow | /Search/ |
| Disallow | /search/ |
| Disallow | /mktnews/ |
| Disallow | /health/mktnews/ |
| Disallow | /health/mktnewsintl/ |
| Disallow | /finance/mktnews/ |
| Disallow | /finance/mktnewsintl/ |
| Disallow | /world/mktnews/ |
| Disallow | /testpages/ |
| Disallow | /rss/tvfinanceticker/ |
| Disallow | /rss/tvticker/ |
| Disallow | /*.. |
| Disallow | /*%26lt%3B |
| Disallow | /cmspages/newsmax/login |
| Disallow | /t/logout |
| Disallow | /*?vtype=main |
| Disallow | /opscotest/ |
| Disallow | /netizen/ |
| Disallow | /dfp/ |
| Disallow | /sto/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.newsmax.com/sitemaps/sitemap-index.xml |
| sitemap | https://www.newsmax.com/sitemaps/all/sitemap-index.xml |
Warnings
- 2 invalid lines.
Comments