Daniel Petro Maybe there is a way to already do this??
But what would be ideal IMO - is to be able to set up an environmental global enum for LLM models that you could populate with various model names - this way - the API could have the "global enum variable" for the model - but you could click on it and change to any of the values in the enum. This way - you could quickly test other models after you are happy your API.
If there already is a method / workaround to do this lemme know!!!