Attendees will explore the potential of open-source AI solutions in this presentation and/or demo. We'll dive into practical demonstrations using the LLaMA-Factory library to finetune open-sourced models (e.g. qwen, llama). We will also showcase how to efficiently host and serve these models on vLLM. This session aims to empower practitioners to move past proprietary AI providers by leveraging several open-source frameworks. Key benefits include full control over model behavior, cost efficiency through self-hosting, and the ability to tailor models using advanced fine-tuning techniques.
