Building a Local Large Language Model (LLM)

Another talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end. You can connect with all the people on this podcast on LinkedIn at: Mark Campbell Dimitri Saradakis Rob O'Connor Here are links to some of the tools referenced in the podcast: Red Hat OpenShift AI LMStudio Ollama HuggingFace

You can listen to Building a Local Large Language Model (LLM) online on Radio and Podcast. Open the player on this page to stream the available audio.

Building a Local Large Language Model (LLM) is an episode from The Machine: A computer science education podcast by Rob O'Connor.

This episode is 00:51:30 long.

This episode was published on Feb 8, 2024.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from The Machine: A computer science education podcast when more episodes are available from the podcast feed.