Radio and PodcastRadio and PodcastLive Radio & Podcasts
514: Running Local LLMs in VS Code artwork
Technology

514: Running Local LLMs in VS Code

Merge Conflict by soundbite.fm

May 11, 202655:46Technology

In this episode James and Frank dive into running AI coding models locally versus in the cloud—BYOK/Open Router, VS Code’s chat/agent harness, model runners (Olama, vLLM), and the practicality of 27B models on a 3090 usi...