ynet.co.il
robots.txt

Robots Exclusion Standard data for ynet.co.il

Resource Scan

Scan Details

Site Domain ynet.co.il
Base Domain ynet.co.il
Scan Status Ok
Last Scan2024-05-03T03:36:41+00:00
Next Scan 2024-05-10T03:36:41+00:00

Last Scan

Scanned2024-05-03T03:36:41+00:00
URL https://ynet.co.il/robots.txt
Redirect https://www.ynet.co.il/robots.txt
Redirect Domain www.ynet.co.il
Redirect Base ynet.co.il
Domain IPs 184.25.221.137
Redirect IPs 104.83.197.137, 2600:1413:1:489::30bc, 2600:1413:1:49b::30bc
Response IP 184.51.97.227
Found Yes
Hash 5a0ea8e5d27902c7a589037bc0ab475fb23683aebdc0c1ffc00f21b9b655c52a
SimHash 009c5108eb91

Groups

*

Rule Path
Disallow /english/
Disallow /Ext/App/Thumbnails/CdaThumbnails_OpenWin/
Disallow /Ext/App/Billing/Login/CdaRegBill_UserIdentificationComponentIFrame/
Disallow /Ext/Comp/ArticleLayout/CdaSendArticleResponse/
Disallow /YediothPortal/Ext/TalkBack/CdaViewTalkBack/
Disallow /YediothPortal/Ext/TalkBack/CdaTalkBack/
Disallow /YediothPortal/Ext/Chn/Astrology/CdaPrevewPrint/
Disallow /home/*%2C7340%2CL-313%2C00.html
Disallow /home/*%2C7340%2CL-847%2C00.html
Disallow /home/*%2C7340%2CL-300%2C00.html
Disallow /home/*%2C7340%2CL-5020%2C00.html
Disallow /home/*%2C7340%2CL-7854%2C00.html
Disallow /home/*%2C7340%2CL-5019%2C00.html
Disallow /home/*%2C7340%2CL-5022%2C00.html
Disallow /home/*%2C7340%2CL-5025%2C00.html
Disallow /home/*%2C7340%2CL-5026%2C00.html
Disallow /home/*%2C7340%2CL-5028%2C00.html
Disallow /home/*%2C7340%2CL-5032%2C00.html
Disallow /Ext/Comp/ArticleLayout/CdaArticlePrintPreview
Disallow /Ext/Comp/Ticker/
Disallow /Ext/Comp/CdaNewsFlash/
Disallow /Ext/App/Ency/Items/
Disallow /home/0%2C7340%2CL-10613%2C00.html
Disallow /Ext/App/Ency/Items/CdaAppEncyTVProgram/
Disallow /YediothPortal/Ext/TalkBack/CdaTalkBackTrans/
Disallow /YediothPortal/Ext/App/TDG/CdaSendTo_Discgrp/
Disallow /YediothPortal/Ext/Chn/Astrology/AstrologyPopSend_message/
Disallow /novgnpre/Ext/Comp/ArticleLayout/CdaArticleSendtoForm1024/
Disallow /Ext/App/TalkBack/CdaAddTalkbackRecommendation/
Disallow /YediothPortal/Ext/App/TDG/CdaPrintDiscgrp/
Disallow /articlesnc/
Disallow /homenc/
Disallow /tags/JDate