bug: Unsupported Parameter Errors for model o1-mini & o1-preview

[PucaVaz]

Jan version

v0.5.4-649

Describe the Bug

I can't disable the stop words, so I get this error

Unsupported parameter: 'stop' is not supported with this model.
Jan’s in beta. Access troubleshooting assistance now.

Steps to Reproduce

Just try to use the newer model from open ai, the o1-preview

Screenshots / Logs

### What is your OS?

• MacOS
• Windows
• Linux

[imtuyethan]

Duplicate with #3771

Reproducible:

[imtuyethan]

Should be fixed as a part of Remote API Extension #3505

[imtuyethan]

Related #3771

[louis-jan]

Hi @PucaVaz @imtuyethan. Could you please help try the latest version, 0.5.8, to see if the issue has been resolved?

[PucaVaz]

@louis-jan for sure, just one second

[PucaVaz]

Now it's work, but not by default, i need to change a few things, in order to work, by setting the temperature to 1, top P to 1 and stream to off, it's cool that now works

It's strange that if an error occurs, the message doesn't say anything about it.

[louis-jan]

Thanks @PucaVaz, we’ll handle the message error gracefully.

[imtuyethan]

@louis-jan Can reproduce on my end:

Screen.Recording.2024-11-18.at.5.31.11.PM.mov

[imtuyethan]

They work now; however:

• There's no way to adjust the stream settings? I can't see the option to turn it on & off. Now, all responses default to turn off stream.
• This is a big friction in user experience because the Generating Response indicator feels stuck & unnatural over a simple prompt.

OpenAI o1-mini

Screen.Recording.2024-11-20.at.4.00.06.PM.mov

OpenAI o1-preview

Screen.Recording.2024-11-20.at.4.02.09.PM.mov

cc @louis-jan

[louis-jan]

@imtuyethan o1 beta models do not support stream. See https://openai.com/index/introducing-openai-o1-preview/
The API for these models currently doesn't include function calling, streaming, support for system messages, and other features

[imtuyethan]

Updated: will fix