Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Azure AI inference #4683

Open
yanivvak opened this issue Dec 12, 2024 · 4 comments · May be fixed by #4723
Open

Adding Azure AI inference #4683

yanivvak opened this issue Dec 12, 2024 · 4 comments · May be fixed by #4723
Assignees
@yanivvak
Labels
proj-extensions
Milestone
0.4.1

Comments

@yanivvak
Copy link

What feature would you like to be added?

Adding Azure AI Model Inference is an API that exposes a common set of capabilities for foundational models and that can be used by developers to consume predictions from a diverse set of models in a uniform and consistent way
https://learn.microsoft.com/en-us/azure/ai-studio/reference/reference-model-inference-api?tabs=python

Why is this needed?

It will improve the integration of Autogen with leading model in Azure ecosystem with 20 foundation models
https://learn.microsoft.com/en-us/azure/ai-studio/reference/reference-model-inference-api?tabs=python
@ekzhu
Copy link
Collaborator

ekzhu commented Dec 12, 2024

@rohanthacker has been working on #3902 which is the same task as this issue.

@rohanthacker are you still working on it? It has been awhile and we need this for 0.4 release. @yanivvak could you help out here?

@ekzhu ekzhu added this to the 0.4.0 milestone Dec 12, 2024
@ekzhu ekzhu marked this as a duplicate of #3902 Dec 12, 2024
@ekzhu ekzhu mentioned this issue Dec 12, 2024
Closed
@rohanthacker
Copy link
Contributor

I have this close to completion. I will submit a draft PR in a few hours.

@ekzhu
Copy link
Collaborator

ekzhu commented Dec 15, 2024

I have this close to completion. I will submit a draft PR in a few hours.

@rohanthacker please let us know by tomorrow as we would like to proceed without being blocked thanks.

@rohanthacker rohanthacker linked a pull request Dec 16, 2024 that will close this issue
Draft
2 tasks
@rohanthacker
Copy link
Contributor

@ekzhu and @yanivvak I've opened a draft PR for the same. Do let me know your feedback.

@ekzhu ekzhu linked a pull request Dec 17, 2024 that will close this issue
Added Azure AI Chat Completion Client #4723
Draft
2 tasks
@ekzhu ekzhu modified the milestones: 0.4.0, 0.4.1 Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yanivvak yanivvak

Labels
proj-extensions
Projects
None yet
Milestone
0.4.1
Development

Successfully merging a pull request may close this issue.

Added Azure AI Chat Completion Client rohanthacker/autogen
3 participants
@ekzhu @rohanthacker @yanivvak