Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for GPT-4o November 2024 Model and Update Configurations #1374

Merged
merged 3 commits into from
Dec 2, 2024

Conversation

KennyDizi
Copy link
Contributor

@KennyDizi KennyDizi commented Nov 21, 2024

PR Type

Dependencies, Configuration


PR Description

  • Added support for the new gpt-4o-2024-11-20 model across configuration files
  • Updated model configurations to use the latest GPT-4o model variants
  • Upgraded litellm dependency to version 1.52.12 to ensure compatibility

Changes Walkthrough

Relevant files
Dependencies
__init__.py
Add GPT-4o November 2024 Model Token Configuration             

pr_agent/algo/init.py

  • Added new model gpt-4o-2024-11-20 to the model token configuration
  • Specified token limit of 128,000 for the new model
  • +1/-0     
    requirements.txt
    Upgrade LiteLLM Dependency                                                             

    requirements.txt

    • Upgraded litellm from version 1.52.0 to 1.52.12
    +1/-1     
    Configuration
    configuration.toml
    Update Default and Fallback Model Configurations                 

    pr_agent/settings/configuration.toml

  • Updated model_turbo to gpt-4o-2024-11-20
  • Updated fallback_models to use gpt-4o-2024-08-06
  • +2/-2     

    @KennyDizi KennyDizi changed the title Add support model gpt-4o-2024-11-20 Add Support for GPT-4o November 2024 Model and Update Configurations Nov 21, 2024
    @KennyDizi
    Copy link
    Contributor Author

    🌟 🌔 The PR description is now updated to correspond with the most recent commit (7d1b6c2).

    @mrT23
    Copy link
    Collaborator

    mrT23 commented Dec 2, 2024

    Thanks for the PR @KennyDizi

    We might want to further change the model usage, but let's save it for a new PR

    @mrT23 mrT23 merged commit b440301 into Codium-ai:main Dec 2, 2024
    2 checks passed
    @mrT23
    Copy link
    Collaborator

    mrT23 commented Dec 2, 2024

    Note that this PR actually broke the publishing.
    Unfortunately upgrading litellm is sometimes problematic.

    image

    (in this case, openai should also have been upgraded:
    microsoft/sample-app-aoai-chatGPT#1190)

    @KennyDizi
    Copy link
    Contributor Author

    @mrT23 that's a good catch. The libs change frequently, and we need to adapt to it.

    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    None yet
    Projects
    None yet
    Development

    Successfully merging this pull request may close these issues.

    2 participants