Ai_010 - Tools for Running Local LLMs

December 14, 2023 00:39:47
Ai_010 - Tools for Running Local LLMs
AI Unchained
Ai_010 - Tools for Running Local LLMs

Dec 14 2023 | 00:39:47

/

Hosted By

Guy Swann

Show Notes

Today we dive into a few of my favorite tools for running LLMs locally on your machine, even the average consumer machine. With a huge variety of models to choose from and varying levels of customization and presets, these will get you started on running your own Ai, and getting the pieces necessary to connect them into micro apps and other parts of your workflow. Not only are these huge productivity boosters to have, but it's also just a ton of fun to play around.

For the large list of links to these and so many other AI tools to check out, go to bitcoinaudible.com/ai (Link: bitcoinaudible.com/ai)


Links to the tools and the models mentioned in the episode


Models mentioned


Host Links


Check out our awesome sponsors!

Other Episodes

Episode

June 06, 2024 00:54:12
Episode Cover

Ai_027 - Is AI Breaking the Web?

A trend I've noticed with Ai, is that it has shifted itself into the middleman position between everyone and the normal surfing of the...

Listen

Episode

October 10, 2024 01:01:40
Episode Cover

Ai Read_012 - The Subprime AI Crisis

What do numerous over-hyped product launches, massively subsidized compute, over extended investment, lack of customer adoption, unwillingness to pay extra, enormous and increasing costs,...

Listen

Episode

July 04, 2023 01:27:03
Episode Cover

Ai_005 - Ai, Fiat Incompatible with Kody Low

"So we had built this for a while, but because API calls are basically free, there really wasn't a good match for it. There...

Listen