Skip to content

Support multiple LLM providers with auto-detection #20

Description

@ajianaz

Description

Allow cora-cli to automatically detect which LLM providers are available based on environment variables and provide a fallback chain.

Acceptance Criteria

  • Auto-detect provider from env vars: OPENAI_API_KEY → OpenAI, ANTHROPIC_API_KEY → Anthropic, GOOGLE_API_KEY → Google
  • Support provider fallback chain in config: providers: [openai, anthropic]
  • Auto-select best available model for the provider
  • Log which provider/model is being used
  • Support custom OpenAI-compatible endpoints (Ollama, vLLM, etc.)

Config Example

provider:
auto_detect: truefallback:
- name: openaiapi_key_env: OPENAI_API_KEY
- name: anthropicapi_key_env: ANTHROPIC_API_KEY

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions