Support for Cerebras

[mridula-plivo]

Can you also add support for AI inference with Cerebras?

https://inference-docs.cerebras.ai/introduction?_gl=1*1bp8hjp*_ga*NTgyNDE2ODgyLjE3MzIxMDY5MTM.*_ga_M90K89G16V*MTczMjE2NTE4My4yLjEuMTczMjE2NTQyMy4wLjAuMA..

[manthanguptaa]

Thank you so much @mridula-plivo for suggesting Cerebras AI inference support! It's really valuable when our users share ideas for integrations that could make our product more powerful. I've noted this suggestion and will share it internally with the team.

[mridula-plivo]

Hey @manthanguptaa . Did you get a chance to discuss this with your team? Any ETA?

[LuisYordano]

Hi @mridula-plivo, You can run the Cerebras API with the following Code Snippet:

from os import getenv
from phi.agent import Agent, RunResponse
from phi.model.openai.like import OpenAILike

agent = Agent(
    model=OpenAILike(
        id="llama-3.3-70b",
        api_key=getenv("CEREBRAS_API_KEY"),
        base_url="https://api.cerebras.ai/v1",
    )
)

# Get the response in a variable
# run: RunResponse = agent.run("Share a 2 sentence horror story.")
# print(run.content)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")