minus-squareCaptnBook@feddit.orgtoSelfhosted@lemmy.world•Faster Ollama alternativelinkfedilinkEnglisharrow-up0·1 month agoVllm unfortunately doesn’t support switching the model without a restart. linkfedilink
Vllm unfortunately doesn’t support switching the model without a restart.