Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bump autoevals version #108

Merged
merged 1 commit into from
Jan 10, 2025
Merged

bump autoevals version #108

merged 1 commit into from
Jan 10, 2025

Conversation

sachinpad
Copy link
Contributor

No description provided.

@sachinpad sachinpad requested a review from manugoyal January 10, 2025 01:13
@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 10, 2025 •
edited
Loading

Braintrust eval report

Autoevals (sachin-bump-version-1736471608)

Score Average Improvements Regressions
NumericDiff 62.7% (-12pp) 7 🟢 33 🔴
Start 1736471608.62s - -
End 1736471612s - -
Duration 3.23s (+1.67s) 1 🟢 100 🔴
Llm_duration 2.48s (+0.94s) 1 🟢 -
Prompt_tokens 277.93tok (-1.26tok) 40 🟢 -
Completion_tokens 17.97tok (-0.05tok) 20 🟢 23 🔴
Total_tokens 295.9tok (-1.31tok) 56 🟢 18 🔴
Estimated_cost 0$ (0$) - -

@sachinpad sachinpad merged commit 89027be into main Jan 10, 2025
8 checks passed
@sachinpad sachinpad deleted the sachin-bump-version branch January 10, 2025 17:46
@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 10, 2025 •
edited
Loading

Braintrust eval report

Autoevals (main-1736531181)

Score Average Improvements Regressions
NumericDiff 71.5% (+9pp) 21 🟢 -
Start 1736531180.86s - -
End 1736531182.41s - -
Duration 1.52s (-1.7s) 102 🟢 19 🔴
Llm_duration 1.51s (-0.97s) 9 🟢 12 🔴
Prompt_tokens 278.8tok (+0.86tok) - 31 🔴
Completion_tokens 17.95tok (-0.05tok) 1 🟢 -
Total_tokens 296.74tok (+0.8tok) 1 🟢 31 🔴
Estimated_cost 0$ (+0$) - -

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@manugoyal manugoyal manugoyal approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@sachinpad @manugoyal