quant param fix

quantization

cors middleware

tp arg

removed reload endpoint, added tensor parallel opt

del instead of = None

using pip vllm

last but log

lock condition typo

test data_parallel_group

end generate on reload

.

fixed missing func call

destroy model parallel

last