Add vllm integration#2

HarshaVardhanMannem wants to merge 4 commits into

brevdev:mainbrevdev/setup-scripts:mainfrom

HarshaVardhanMannem:add-vllm-integrationHarshaVardhanMannem/setup-scripts:add-vllm-integrationCopy head branch name to clipboard