-
Notifications
You must be signed in to change notification settings - Fork 2.6k
Issues: openai/evals
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Cannot pass the check and got this error: KeyError: 'sample'
bug
Something isn't working
#1012
opened May 23, 2023 by
14H034160212
oaieval fails with error UnicodeDecodeError: 'charmap' codec can't decode byte
bug
Something isn't working
#980
opened May 17, 2023 by
rslinford
eval approach: GPT4 provides alternative responses with reasoning and then has to pick the best one
#968
opened May 14, 2023 by
qrdlgit
Remove leading whitespace from sampled answers in Match template
#947
opened May 9, 2023 by
keltin13
pip install evals throws AssertionError
bug
Something isn't working
#918
opened May 4, 2023 by
CholoTook
Feature suggestion - Save and Load Conversation History
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
#907
opened May 3, 2023 by
wawryszukd
Safety Eval Idea: allergen information of different food products in the Israeli market.
#874
opened Apr 30, 2023 by
ido777
Idea for eval - Bible knowledge as tested in the yearly International Bible youth Contest
#840
opened Apr 27, 2023 by
ido777
Please add an option to change language or understand other languages
#795
opened Apr 24, 2023 by
0XxMuzanxX0
Eval idea: Security code review for unicode attacks on code
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
#787
opened Apr 24, 2023 by
qrdlgit
Idea for Evals: Count how many numbers are greater than or less than X
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
#785
opened Apr 23, 2023 by
voynow
Idea for Evals: Sorting numbers with repeats and negatives
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
#782
opened Apr 23, 2023 by
voynow
I believe that in order for GPT-4 to create by itself many inventions through two month, necessary that...
#685
opened Apr 15, 2023 by
55255ru
ProTip!
Adding no:label will show everything without a label.