news1.co.il
robots.txt
Robots Exclusion Standard data for news1.co.il
Resource Scan
Scan Details
Site Domain | news1.co.il |
Base Domain | news1.co.il |
Scan Status | Ok |
Last Scan | 2024-11-09T05:44:12+00:00 |
Next Scan | 2024-11-16T05:44:12+00:00 |
Last Scan
Scanned | 2024-11-09T05:44:12+00:00 |
URL | https://news1.co.il/robots.txt |
Redirect | https://www.news1.co.il/robots.txt |
Redirect Domain | www.news1.co.il |
Redirect Base | news1.co.il |
Domain IPs | 104.26.14.46, 104.26.15.46, 172.67.75.31, 2606:4700:20::681a:e2e, 2606:4700:20::681a:f2e, 2606:4700:20::ac43:4b1f |
Redirect IPs | 104.26.14.46, 104.26.15.46, 172.67.75.31, 2606:4700:20::681a:e2e, 2606:4700:20::681a:f2e, 2606:4700:20::ac43:4b1f |
Response IP | 172.67.75.31 |
Found | Yes |
Hash | 8425685323315393530977415886ffd6dff77f2225a3434ee272eb824591302c |
SimHash | aa48c422dbda |
Groups
*
Rule | Path |
---|---|
Disallow | /showtitles.aspx |
Disallow | /tagssearchresults.aspx |
Disallow | /ArticlePrintVersion.aspx |
Disallow | /FirmPrintVersion.aspx |
Disallow | /MemberMsgBankListPrintVersion.aspx |
Disallow | /PeoplePrintVersion.aspx |
Disallow | /GetTalkBack.aspx |
Disallow | /showTalkBack.aspx |
Disallow | /ShowTalkBackForHtml.aspx |
Disallow | /MemberLogin.aspx |