yeshiva.org.il
robots.txt

Robots Exclusion Standard data for yeshiva.org.il

Resource Scan

Scan Details

Site Domain yeshiva.org.il
Base Domain yeshiva.org.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-25T01:03:37+00:00
Next Scan 2026-04-26T01:03:37+00:00

Last Successful Scan

Scanned2025-12-27T20:19:01+00:00
URL https://yeshiva.org.il/robots.txt
Redirect https://www.yeshiva.org.il/robots.txt
Redirect Domain www.yeshiva.org.il
Redirect Base yeshiva.org.il
Domain IPs 104.26.0.46, 104.26.1.46, 172.67.69.71, 2606:4700:20::681a:12e, 2606:4700:20::681a:2e, 2606:4700:20::ac43:4547
Redirect IPs 104.26.0.46, 104.26.1.46, 172.67.69.71, 2606:4700:20::681a:12e, 2606:4700:20::681a:2e, 2606:4700:20::ac43:4547
Response IP 172.67.69.71
Found Yes
Hash 4de7b906236e119d23eaaab8b8b630427fa910d35d554eb9d3291c134a377d88
SimHash 14f5d7700f90

Groups

*

Rule Path
Disallow /404
Disallow /500
Disallow /Users/
Allow /Users/GetUserCookies/
Allow /Users/UserName/
Allow /Users/register/
Disallow /responsa/Responsa.aspx
Disallow /ask/printAsk.aspx
Disallow /reg/recommend.aspx
Disallow /midrash/printshiur.aspx
Disallow /midrash/outer
Disallow /ask/outer
Disallow /article/outer
Disallow /calendar/printcalendar.aspx
Disallow /calendar/timesplaces.aspx
Disallow /calendar/YeshivaTimes.aspx
Disallow /calendar/eng/eprintcalendar.aspx
Disallow /wiki2/
Disallow /psakim/
Disallow /oldEng/
Disallow /frames/esi
Disallow /esi_angular
Disallow /midrashAngular/
Disallow /wiki/*action%3Dedit
Disallow /wiki/*printable%3Dyes
Disallow /wiki/api.php
Disallow /wiki/*%D7%9B%D7%A0%D7%99%D7%A1%D7%94_%D7%9C%D7%97%D7%A9%D7%91%D7%95%D7%9F
Disallow /wiki/*%D7%94%D7%A8%D7%A9%D7%9E%D7%94_%D7%9C%D7%97%D7%A9%D7%91%D7%95%D7%9F
Disallow /wiki/*mobileaction%3Dtoggle_view_desktop
Disallow /wiki/*bookcmd
Disallow /wiki/*hideredirs
Disallow /wiki/*hidetrans
Disallow /wiki/*return_to
Disallow /wiki/*mobileaction
Disallow /ViewSwitcher/SwitchView
Disallow /frames/esi
Disallow /images/rabanim/*%26v
Disallow /midrashview/template
Disallow /angularview/template
Disallow /warehouse

adsbot-google-mobile
adsbot-google

Rule Path
Disallow /info/

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow /wiki/ disallow this directory

Other Records

Field Value
sitemap https://www.yeshiva.org.il/Sitemap.aspx