Uh oh!
There was an error while loading. Please reload this page.
[feature] Adubatl/model fetching poc - #326
Conversation
…/wiz flows, but also for searchable models)
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
please use uv instead of poetry
braelyn-ai
commented
Feb 21, 2025
overall comment, i would say undo the linter changes. there's a ton of noise in this pr. if we want to make linter changes, it'd be better to apply it as a rule to the entire codebase and require it as github check (i.e. what we did with ruff). otherwise people's IDE's will be competing with each other |
braelyn-ai
commented
Feb 21, 2025
moved it out of draft to run tests |
adubatl
commented
Feb 21, 2025
I had this as a draft cause I was just messin around getting to understand the codebase - happy to close it out or take it back to my fork and play there! Don't wanna bog you down with a feature change thats just nice to have if it aint the focus. |
📥 Pull Request
I originally wanted to be super fancy and hit a bunch of apis buuuuut then noticed litellm has built in model/provider mappings so I went to use that.
Once I got to testing a list of 500~ models was horrific, attempted to enable search but the inquirer we chose doesnt do any of that fancy stuff.
So that lead to me replacing the lib with a diff one and trying to preserve all of the flavor and soul in the existing wizard, but with a better lib for the future of the app.
📘 Description
🙏 🕯️ 🙏
We would like to take this moment to thank inquirer for their/its service.
🙏 🕯️ 🙏
Questionary seems like a more active and up to date tool, its probably overkill, but it had search yaaaay.
Its got a lot more support for robust CLI interactivity, and more importantly... it let me search a much longer model list lol.
Replaced all inquirer with questionary. There is yet another inquirer model included in the exampled poetry locks but thats not my concern just yet.
litellm.models_by_providergiving us the models in our expected format by default 🥇TODO
🧪 Testing
I tried one model and it worked. Ill validate more later.