AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui Podcast By  cover art

AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui

AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui

Listen for free

View show details

Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.

No reviews yet