israelnationalnews.com
robots.txt
Robots Exclusion Standard data for israelnationalnews.com
Resource Scan
Scan Details
Site Domain | israelnationalnews.com |
Base Domain | israelnationalnews.com |
Scan Status | Ok |
Last Scan | 2024-05-14T18:51:05+00:00 |
Next Scan | 2024-05-21T18:51:05+00:00 |
Last Scan
Scanned | 2024-05-14T18:51:05+00:00 |
URL | https://israelnationalnews.com/robots.txt |
Redirect | https://www.israelnationalnews.com/robots.txt |
Redirect Domain | www.israelnationalnews.com |
Redirect Base | israelnationalnews.com |
Domain IPs | 104.18.12.170, 104.18.13.170, 2606:4700::6812:caa, 2606:4700::6812:daa |
Redirect IPs | 104.18.12.170, 104.18.13.170, 2606:4700::6812:caa, 2606:4700::6812:daa |
Response IP | 104.18.12.170 |
Found | Yes |
Hash | f2f090aa403a2a47d1f09d5f390d367d583e69b66714b2371d5256a800bb0125 |
SimHash | b7705845f3f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /Controls/ |
Disallow | /My/Calendar/Print.aspx |
Disallow | /News/Flash.aspx/ |
Disallow | /Generic/Generic |
Disallow | /Generic/IOS/ |
Disallow | /ForumPost/ |
Disallow | /Forum/User/* |
Disallow | /My/PrivateBox/* |
Disallow | /Search/* |
Disallow | /Album.aspx/* |
Disallow | /flashes/1*$ |
Disallow | /flashes/2*$ |
Disallow | /flashes/3*$ |
Disallow | /flashes/4*$ |
Disallow | /flashes/5*$ |
Disallow | /News/Section.aspx/28 |
Disallow | /section/28 |
Disallow | /News/Section.aspx/1 |
Disallow | /section/1 |
Disallow | /News/Section.aspx/13 |
Disallow | /section/13 |
Disallow | /News/Section.aspx/15 |
Disallow | /section/15 |
Disallow | /News/Section.aspx/21 |
Disallow | /section/21 |
Disallow | /News/Section.aspx/29 |
Disallow | /section/29 |
Disallow | /News/Section.aspx/3 |
Disallow | /section/3 |
Disallow | /News/Section.aspx/36 |
Disallow | /section/36 |
Disallow | /News/Section.aspx/6 |
Disallow | /section/6 |
Disallow | /News/Section.aspx/8 |
Disallow | /section/8 |
Disallow | /News/Section.aspx/9 |
Disallow | /section/9 |
Warnings
- `host` is not a known field.