Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please, when possible, add Sambanova models to the list of litellm custom providers #1296

Closed
arreumb opened this issue Jan 6, 2025 · 1 comment
Labels
bug Something isn't working enhancement New feature or request question Further information is requested

Comments

@arreumb
Copy link

arreumb commented Jan 6, 2025

Request to litellm:
litellm.completion(messages=[{'role': 'user', 'content': 'Extract: Jason is 25 years old'}], model='sambanova/Meta-Llama-3.1-70B-Instruct', tools=[{'type': 'function', 'function': {'name': 'User', 'description': 'Correctly extracted User with all the required parameters with correct types', 'parameters': {'properties': {'name': {'title': 'Name', 'type': 'string'}, 'age': {'title': 'Age', 'type': 'integer'}}, 'required': ['age', 'name'], 'type': 'object'}}}], tool_choice={'type': 'function', 'function': {'name': 'User'}})

File "/home/umby/groq/lib/python3.11/site-packages/instructor/retry.py", line 181, in retry_sync
raise InstructorRetryException(
instructor.exceptions.InstructorRetryException: LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=sambanova/Meta-Llama-3.1-70B-Instruct
Pass model as E.g. For 'Huggingface' inference endpoints pass in completion(model='huggingface/starcoder',..) Learn more: https://docs.litellm.ai/docs/providers

@github-actions github-actions bot added bug Something isn't working enhancement New feature or request question Further information is requested labels Jan 6, 2025
@arreumb
Copy link
Author

arreumb commented Jan 6, 2025

Sorry, it was just a problem with the litellm package not updated. I close the request.

@arreumb arreumb closed this as completed Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant