Komninos Chatzipapas has Published 1 Articles

Serving Large models - VLLM, LLAMA CPP Server, and SGLang

Komninos Chatzipapas

Komninos Chatzipapas

Updated on 24-Oct-2024 15:26:04

647 Views

Both Large Language Models (LLMs) and Vision-Language Models (VLMs) have exploded in popularity over the last two years. Powered by recent advancements in GPU tech, these models have been pre-trained on trillions of tokens and allow developers to easily leverage state-of-the-art AI, either by fine-tuning them or just using them ... Read More

1
Advertisements