yediot.co.il
robots.txt

Robots Exclusion Standard data for yediot.co.il

Resource Scan

Scan Details

Site Domain yediot.co.il
Base Domain yediot.co.il
Scan Status Ok
Last Scan2024-11-09T19:50:01+00:00
Next Scan 2024-11-16T19:50:01+00:00

Last Scan

Scanned2024-11-09T19:50:01+00:00
URL https://www.yediot.co.il/robots.txt
Domain IPs 104.83.197.137
Response IP 104.83.197.137
Found Yes
Hash 5a0ea8e5d27902c7a589037bc0ab475fb23683aebdc0c1ffc00f21b9b655c52a
SimHash 009c5108eb91

Groups

*

Rule Path
Disallow /english/
Disallow /Ext/App/Thumbnails/CdaThumbnails_OpenWin/
Disallow /Ext/App/Billing/Login/CdaRegBill_UserIdentificationComponentIFrame/
Disallow /Ext/Comp/ArticleLayout/CdaSendArticleResponse/
Disallow /YediothPortal/Ext/TalkBack/CdaViewTalkBack/
Disallow /YediothPortal/Ext/TalkBack/CdaTalkBack/
Disallow /YediothPortal/Ext/Chn/Astrology/CdaPrevewPrint/
Disallow /home/*%2C7340%2CL-313%2C00.html
Disallow /home/*%2C7340%2CL-847%2C00.html
Disallow /home/*%2C7340%2CL-300%2C00.html
Disallow /home/*%2C7340%2CL-5020%2C00.html
Disallow /home/*%2C7340%2CL-7854%2C00.html
Disallow /home/*%2C7340%2CL-5019%2C00.html
Disallow /home/*%2C7340%2CL-5022%2C00.html
Disallow /home/*%2C7340%2CL-5025%2C00.html
Disallow /home/*%2C7340%2CL-5026%2C00.html
Disallow /home/*%2C7340%2CL-5028%2C00.html
Disallow /home/*%2C7340%2CL-5032%2C00.html
Disallow /Ext/Comp/ArticleLayout/CdaArticlePrintPreview
Disallow /Ext/Comp/Ticker/
Disallow /Ext/Comp/CdaNewsFlash/
Disallow /Ext/App/Ency/Items/
Disallow /home/0%2C7340%2CL-10613%2C00.html
Disallow /Ext/App/Ency/Items/CdaAppEncyTVProgram/
Disallow /YediothPortal/Ext/TalkBack/CdaTalkBackTrans/
Disallow /YediothPortal/Ext/App/TDG/CdaSendTo_Discgrp/
Disallow /YediothPortal/Ext/Chn/Astrology/AstrologyPopSend_message/
Disallow /novgnpre/Ext/Comp/ArticleLayout/CdaArticleSendtoForm1024/
Disallow /Ext/App/TalkBack/CdaAddTalkbackRecommendation/
Disallow /YediothPortal/Ext/App/TDG/CdaPrintDiscgrp/
Disallow /articlesnc/
Disallow /homenc/
Disallow /tags/JDate