You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Only one should remain. Preferable one for MessageDeltaEvent.
Add an integration test, e.g. extend the one with max_token=1:
test_case(
name="pinocchio in one token",
max_tokens=1,
messages=[user("tell me the full story of Pinocchio")],
expected=lambda s: len(s.content.split()) <= 1
+ and s.usage is not None+ and s.usage.completion_tokens == 1,
)
The text was updated successfully, but these errors were encountered:
Completion tokens are counted twice:
ai-dial-adapter-bedrock/aidial_adapter_bedrock/llm/model/claude/v3/adapter.py
Line 261 in ef2bc40
ai-dial-adapter-bedrock/aidial_adapter_bedrock/llm/model/claude/v3/adapter.py
Line 274 in ef2bc40
Only one should remain. Preferable one for
MessageDeltaEvent
.Add an integration test, e.g. extend the one with
max_token=1
:The text was updated successfully, but these errors were encountered: