israelnationalnews.com
robots.txt

Robots Exclusion Standard data for israelnationalnews.com

Resource Scan

Scan Details

Site Domain israelnationalnews.com
Base Domain israelnationalnews.com
Scan Status Ok
Last Scan2024-05-14T18:51:05+00:00
Next Scan 2024-05-21T18:51:05+00:00

Last Scan

Scanned2024-05-14T18:51:05+00:00
URL https://israelnationalnews.com/robots.txt
Redirect https://www.israelnationalnews.com/robots.txt
Redirect Domain www.israelnationalnews.com
Redirect Base israelnationalnews.com
Domain IPs 104.18.12.170, 104.18.13.170, 2606:4700::6812:caa, 2606:4700::6812:daa
Redirect IPs 104.18.12.170, 104.18.13.170, 2606:4700::6812:caa, 2606:4700::6812:daa
Response IP 104.18.12.170
Found Yes
Hash f2f090aa403a2a47d1f09d5f390d367d583e69b66714b2371d5256a800bb0125
SimHash b7705845f3f0

Groups

*

Rule Path
Disallow /Controls/
Disallow /My/Calendar/Print.aspx
Disallow /News/Flash.aspx/
Disallow /Generic/Generic
Disallow /Generic/IOS/
Disallow /ForumPost/
Disallow /Forum/User/*
Disallow /My/PrivateBox/*
Disallow /Search/*
Disallow /Album.aspx/*
Disallow /flashes/1*$
Disallow /flashes/2*$
Disallow /flashes/3*$
Disallow /flashes/4*$
Disallow /flashes/5*$
Disallow /News/Section.aspx/28
Disallow /section/28
Disallow /News/Section.aspx/1
Disallow /section/1
Disallow /News/Section.aspx/13
Disallow /section/13
Disallow /News/Section.aspx/15
Disallow /section/15
Disallow /News/Section.aspx/21
Disallow /section/21
Disallow /News/Section.aspx/29
Disallow /section/29
Disallow /News/Section.aspx/3
Disallow /section/3
Disallow /News/Section.aspx/36
Disallow /section/36
Disallow /News/Section.aspx/6
Disallow /section/6
Disallow /News/Section.aspx/8
Disallow /section/8
Disallow /News/Section.aspx/9
Disallow /section/9

Warnings

  • `host` is not a known field.