Support other Copilot LLMs than OpenAI #401
Assignees
Labels
Comments
|
Anthropic mostly works with copilot, except some issues around retrieving malicious packages in natural language chat. |
|
I'll do this together with #415 because the free copilot also supports anthropic. |
jhrozek
added a commit
that referenced
this issue
Dec 19, 2024
With Copilot+Anthropic the user message can contain instructions that are passed from the chat client and really sound like a system message. For whatever reason, the chat client includes them with `role=user`. These instructions confuse the LLM when extracting the package names or ecosystem and it replies with a mix of JSON and natural language. To work around that, Pankaj suggested to tune the system prompt and tell the LLM to ignore the instructions. This seems to work and helps Anthropic extract the package names even with copilot user message. Co-authored-by: Pankaj Telang <[email protected]> Related: #401
|
PR #428 helps to extract package names and ecosystems with Copilot and Anthropic. There will be a follow up to match them in weaviate - we are discussing how to approach that with Pankaj. Once those are fixed, Anthropic will be supported with Copilot! |
|
I co-assigned @ptelang because during testing we saw issues with extracting package names from natural language prompts also with GPT and this needs an LLM expert :-) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Our Copilot provider is fairly tied to it using OpenAI as LLM, but since recently, Copilot can use other LLMs as well. We should support that.
The text was updated successfully, but these errors were encountered: