Skip to content

Issues: openai/evals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Cannot pass the check and got this error: KeyError: 'sample' bug Something isn't working
#1012 opened May 23, 2023 by 14H034160212
Overall Report for Eval Set As a Whole
#939 opened May 8, 2023 by chinggg
docs out of date bug Something isn't working
#929 opened May 7, 2023 by rustam-e
pip install evals throws AssertionError bug Something isn't working
#918 opened May 4, 2023 by CholoTook
Feature suggestion - Save and Load Conversation History Idea for Eval These issues keep track of requests for different kinds of eval PRs
#907 opened May 3, 2023 by wawryszukd
Inaccuracy of AI-generated responses bug Something isn't working
#906 opened May 3, 2023 by vmn2014
Eval idea: Security code review for unicode attacks on code Idea for Eval These issues keep track of requests for different kinds of eval PRs
#787 opened Apr 24, 2023 by qrdlgit
Idea for Evals: Count how many numbers are greater than or less than X Idea for Eval These issues keep track of requests for different kinds of eval PRs
#785 opened Apr 23, 2023 by voynow
Idea for Evals: Sorting numbers with repeats and negatives Idea for Eval These issues keep track of requests for different kinds of eval PRs
#782 opened Apr 23, 2023 by voynow
fix error
#765 opened Apr 23, 2023 by Huymoixode
Mandarin homophones eval 🇨🇳
#689 opened Apr 15, 2023 by ofou
Eval making guide?
#652 opened Apr 12, 2023 by Luka5-A8ram
ProTip! Adding no:label will show everything without a label.