[Bug] 無法使用 AWS Nova 模型

[chiyiliao]

📦 部署环境

Docker

📌 软件版本

1.40.3

💻 系统环境

Ubuntu

🌐 浏览器

Edge

🐛 问题描述

加入 AWS 官方的 Nova 模型，
使用該模型問一個問題，
會出現錯誤訊息！

📷 复现步骤

1. 設定 AWS Bedrock token
2. 加入 AWS 官方 amazon.nova-micro-v1:0 模型
3. 使用該模型問一個問題，例如"嗨"
4. 回覆以下錯誤訊息
   {
   "error": {
   "body": {
   "attempts": 1,
   "requestId": "xxxxxxxxxx",
   "httpStatusCode": 400,
   "totalRetryDelay": 0
   },
   "type": "ValidationException",
   "message": "Malformed input request: #: extraneous key [top_p] is not permitted, please reformat your input and try again."
   },
   "region": "us-east-1",
   "provider": "bedrock"
   }

🚦 期望结果

應該可以得到 Nova 的文字回應

📝 补充信息

No response

[lobehubbot]

👀 @chiyiliao

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[dosubot]

@chiyiliao 你好！我是Dosu，一個可以幫助你解決錯誤、回答問題，甚至成為貢獻者的機器人。如果你需要任何幫助，我會在等待人類維護者的期間幫助你。期待和你一起解決問題！🤖

The error you're encountering indicates that the AWS Nova model does not permit the top_p parameter in the input request. To resolve this issue, you need to modify the request to exclude the top_p parameter when using the Nova model.

Here's a general approach to address this:

1. Locate the part of the code where the request for the AWS Nova model is constructed.
2. Ensure that the top_p parameter is not included in the request for the Nova model. You might need to add a condition to exclude top_p specifically for this model.

If you need further assistance with the code, please provide more details about where the request is being constructed, and I can help you with the specific changes needed.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[chiyiliao]

似乎也無法透過 bedrock 使用 meta 的 llama3 模型，會出現以下錯誤！
"Malformed input request: #: required key [prompt] not found#: extraneous key [system] is not permitted#: extraneous key [max_tokens] is not permitted#: extraneous key [messages] is not permitted#: extraneous key [anthropic_version] is not permitted, please reformat your input and try again."