You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the feature or improvement you're requesting
Eval name
bible knowledge in Hebrew
Eval description
The Bible is the core of the Jewish / Hebrew culture. Once a year there is an international contest in Jerusalem for youth about the bible. It requires them to know the bible by heart and to answer detailed context questions when they are given only small and partial quotes.
What makes this a useful eval?
Having a model capable to answer it is similar to the deep blue winning Kasparov and can be used for preparation for the students and the contest administration. Making this eval work will make headlines in Israel and the Jewish world. Except for headlines, it can become a tool for students and teachers for contest preparation.
Describe the feature or improvement you're requesting
Eval name
bible knowledge in Hebrew
Eval description
The Bible is the core of the Jewish / Hebrew culture. Once a year there is an international contest in Jerusalem for youth about the bible. It requires them to know the bible by heart and to answer detailed context questions when they are given only small and partial quotes.
What makes this a useful eval?
Having a model capable to answer it is similar to the deep blue winning Kasparov and can be used for preparation for the students and the contest administration. Making this eval work will make headlines in Israel and the Jewish world. Except for headlines, it can become a tool for students and teachers for contest preparation.
Additional context
PR #784
See an article about the winner of last contest that took place 26 Apr 20203
Event video
The text was updated successfully, but these errors were encountered: