Unable to use Baseten with Instructor #664
Unanswered
duncandevs
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Trying to use baseten with instructor and keep running into the following error
AssertionError: Instructor does not support multiple tool calls, use List[Model] instead.
for more context to use Baseten requires making the following changes to the client
openAiClient = OpenAI( api_key=<baseten_api_key>, base_url=<baseten_model_url> )
and the model is changed to
minstral-7b
Beta Was this translation helpful? Give feedback.
All reactions