💄 config: Add qwen vision models #2879
Conversation
|
@sxjeru is attempting to deploy a commit to the LobeHub Team on Vercel. A member of the Team first needs to authorize it. |
|
👍 @sxjeru Thank you for raising your pull request and contributing to our Community |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #2879 +/- ##
==========================================
- Coverage 93.30% 93.16% -0.14%
==========================================
Files 383 382 -1
Lines 23931 23948 +17
Branches 2544 2676 +132
==========================================
- Hits 22328 22312 -16
- Misses 1603 1636 +33
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
|
目前支持发送图片链接聊天，不过模型存在一些固有缺陷：
|
Currently, sending image links for chat is supported, but the model has some inherent flaws:
|
|
理论上已经支持 s3 上传的图片，由于阿里云疑似屏蔽了 eu.org 图片网址，导致这边无法实际测试。 |
Theoretically, images uploaded via s3 are supported. However, Alibaba Cloud seems to have blocked the eu.org image URL, making it impossible to actually test it here. |
| @@ -1,16 +1,63 @@ | |||
| import OpenAI from 'openai'; | |||
|
|
|||
| import { ModelProvider } from '../types'; | |||
| import { ModelProvider, UserMessageContentPart, OpenAIChatMessage } from '../types'; | |||
| import { LobeOpenAICompatibleFactory } from '../utils/openaiCompatibleFactory'; | |||
|
|
|||
| export const LobeQwenAI = LobeOpenAICompatibleFactory({ | |||
| baseURL: 'https://dashscope.aliyuncs.com/compatible-mode/v1', | |||
| chatCompletion: { | |||
#3114 |
识别消息中的图片链接属于妥协方案，若粘贴图片能正常聊天，则不必添加。其他 provider 也没有支持。 |
Recognizing image links in messages is a compromise. If pasting the image will allow normal chat, there is no need to add it. Other providers are not supported either. |
💻 变更类型 | Change Type
📝 补充信息 | Additional Information
由 #3114 替代。
S3 可用，先进行适配。
由于 Qwen VL 不支持当前的 Base64 图片，本 PR 延后至 lobe-chat 兼容 openai 的文件接口做好后再作完善。image
🔀 变更说明 | Description of Change
添加并选择 Qwen VL Max 模型默认启用。
由于 Qwen2 开源模型在性能与价格上都超越了原始 Qwen 模型，所以更改了默认模型。
image