Skip to content
This repository was archived by the owner on Mar 15, 2026. It is now read-only.

Add support for Azure OpenAI, Palm, Claude-2, Llama2, CodeLlama (100+LLMs) - #154

Open
ishaan-jaff wants to merge 1 commit into
NimbleBoxAI:mainfrom
ishaan-jaff:main
Open

Add support for Azure OpenAI, Palm, Claude-2, Llama2, CodeLlama (100+LLMs) #154
ishaan-jaff wants to merge 1 commit into
NimbleBoxAI:mainfrom
ishaan-jaff:main

Conversation

@ishaan-jaff

Copy link
Copy Markdown

This PR adds support for the above mentioned LLMs using LiteLLM https://github.com/BerriAI/litellm/
Example

fromlitellmimportcompletion## set ENV variablesos.environ["OPENAI_API_KEY"] ="openai key"os.environ["COHERE_API_KEY"] ="cohere key"messages= [{ "content": "Hello, how are you?","role": "user"}]
# openai callresponse=completion(model="gpt-3.5-turbo", messages=messages)
# cohere callresponse=completion("command-nightly", messages)
# anthropic callresponse=completion(model="claude-instant-1", messages=messages)

@ishaan-jaff

Copy link
Copy Markdown
Author

@yashbonde@vgulerianb can I get a review on this PR ?

happy to add docs/testing if this initial commit looks good

Noticed you're allowing users to build LLM apps and I thought having more LLM will improve ChainFury

Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@ishaan-jaff