The models, the tools, the implementations, everything is moving incredibly fast.
But a very interesting trend that I’ve been seeing, is that the open source benchmarks are improving just slightly faster than the closed source alternatives. Slowly but surely, they are catching up.
The day may come where the open source models are the best models, the ones with the greatest number of tools, and the largest variety of implementations, because naturally they’re open and available for everyone to work on.
There have been numerous new developments on running models more efficiently, running larger models on even smaller devices, and doing so with less power and computational overhead, as well as a new advancement in one of my favourite open source models, which may just be a big leap forward for how these are going to evolve moving forward. And that is what today’s episode of AI Unchained is all about.
A big leap for local LLMs.

Ai News Roundup
Running Ai locally on a Smartphone: A Performance Evaluation of a Quantized Large Language Model on Various Smartphones (Link: http://tinyurl.com/mv4k7eyp)
LLM in a flash: Efficient Large Language Model Inference with Limited Memory (Link:http://tinyurl.com/mrc5ur7m)

Explore the new Mixtral Model below
Poe.com (Link:https://poe.com/chat/2vdailufawo9jnkcb4l)
Fireworks AI Models (Link: https://app.fireworks.ai/models)
GGUF Model for Local Running (Link: http://tinyurl.com/34btrnre)
Run with LMStudio – LM Studio – Discover, download, and run local LLMs (Link:https://lmstudio.ai/)
Unleashed Chat – One button to deploy your own chat (Link: https://unleashed.chat/app/chat)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

Ai is a powerful tool, and thus, necessarily comes with incredible risk. It could obsolete millions of workers, taking jobs and productive capacity away from humans and consolidate it into corporations. It could make the average individual too dangerous, putting incredible power into the hands of bad people. It may even present an existential threat to humanity, a veritable nuclear bomb, made available to everyone in the world…
What could all of this mean? Doesn’t it suggests we need to tightly control, license, and scrutinize access to these base tools? Or is there an underlying philosophy exposed by these fears, and a more prudent, and honest course of action? find out in today’s Ai Unchained episode!
Check out the link to the video of Yann LeCun that was shared toward the end of this episode, Why Open Source Ai is Our Only Hope (Link: http://tinyurl.com/yx5tmmnv)

Guest Links

Yann LeCun on X (Link: https://twitter.com/ylecun)

Yann LeCun Website (Link: yann.lecun.com/)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

Today we dive into a few of my favorite tools for running LLMs locally on your machine, even the average consumer machine. With a huge variety of models to choose from and varying levels of customization and presets, these will get you started on running your own Ai, and getting the pieces necessary to connect them into micro apps and other parts of your workflow. Not only are these huge productivity boosters to have, but it’s also just a ton of fun to play around.

For the large list of links to these and so many other AI tools to check out, go to bitcoinaudible.com/ai (Link: bitcoinaudible.com/ai)

Links to the tools and the models mentioned in the episode

GPT4All (Link: https://gpt4all.io/index.html)

LM Studio (Link: https://lmstudio.ai/)

Ollama AI (https://ollama.ai/)

Models mentioned

Stablelm-zephyr (small & fast)

Mistral Instruct (good overall, imo)

Hermes (less likely to lecture you)

Llama2 (great base model)

Llava (text and images, multimodal)

Host Links

Guy on Nostr (Link: http://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://www.swanbitcoin.com/)

“Coding has always felt to me like an endlessly deep and rich domain. Now I find myself wanting to write a eulogy for it.”
~ James Somers

Today we dive into an amazing piece and such an important perspective on the future with Ai. With GPT being able to code with ease, so many tasks and projects that would’ve taken hours before. Where the “so-so” programmer can now build nearly anything with an Ai partner, what is to come of the future of coding? Should we be celebrating… or is a eulogy in order?

Check out the original article at A Coder Considers the Waning Days of the Craft | The New Yorker (Link: https://tinyurl.com/56entzua)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/Ai_Unchained)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)

If you are looking to maximize your productivity, to use the Ai tools available in a way that genuinely gives you that 5x improvement of your capabilities, this is the episode for you. These are the 5 ways I am currently using Ai more than any other to maximize my output.

For other links mentioned in the episode:

Ai transcription video from YT (Link: https://www.youtube.com/watch?v=ZDw8ZNFBKes)
Premai.io (Link: https://www.premai.io/)
gpt4all (Link: https://gpt4all.io/index.html)
confyui (Link: https://tinyurl.com/mry8tmhp)
automatic1111 (Link: https://tinyurl.com/36ar9tav)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)

Don’t forget to subscribe and leave a review on your favourite podcast app! It’s hugely appreciated and helps to bring this show to more people.

Feel free to send me any questions you have that you would like me to cover.

“Our first instinct when interacting with a Large Language Model should not be “wow these things must be really smart or really creative or really understanding”. Our first instinct should be “I’ve probably asked it to do something that it has seen bits and pieces of before”. That might mean it is still really useful, even if it isn’t “thinking really hard” or “doing some really sophisticated reasoning”. We don’t have to use anthropomorphization to understand what it is doing to provide us a response.”
~ Mark Riedl

Today we dive into a great piece from Mark Riedl attempting to demystify ChatGPT and large language models. Are they thinking? do they understand reason? Can we even understand what is happening inside these intelligent machines or have we created something we cannot control?
What if the truth is far simpler, and actually easy to understand? And we can cut through all the hype, fear, and confusion, to get at the heart of what this technology really is, and what an incredible tool it can be.
Don’t miss this incredible piece.

Check out the original article – and drop tons of applause – at A Very Gentle Introduction to Large Language Models without the Hype | by Mark Riedl | Medium (Link: https://tinyurl.com/2wm4nmeu)

Guest Links

Mark Riedl on X (Link:https://twitter.com/mark_riedl)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Get 50,000 free sats, plus sats back on everything you buy by signing up with Fold and the Spin+ Debit Card. ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/fold⁠)
Check out the KYC Free, simple, no management, Bitcoin merchant solution – ⁠⁠⁠⁠⁠Nodeless.io⁠⁠⁠⁠⁠⁠. Use my link to go to nodeless.io/guy⁠⁠⁠⁠⁠ and setup your donation page for free, then share it out on nostr/Twitter and tag me, and I’ll throw 10,000 sats your way!

Get 50,000 free sats, plus sats back on everything you buy by signing up with Fold and the Spin+ Debit Card. ⁠⁠⁠⁠⁠⁠bitcoinaudible.com/fold⁠

Obi Nwosu, co-founder and CEO of Fedi, joins us today to talk about the new innovations and challenges in re-decentralizing the web and how both Bitcoin and Ai are at the core of making it possible.

Guest Links

Follow Obi on X (Link: https://x.com/obi)
Follow Fedi on X (Link: https://twitter.com/fedimint)
Fedi Website (Link: https://www.fedi.xyz/)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

What if we could mitigate the enormous centralizing effects of the massive server farms and huge corporate entities, by pooling the GPU power of the millions of users and tinkerers who have unused or regularly idle computational power, into a decentralized marketplace for buying and selling Ai execution, and we could power it all with instantly settled sats over lightning?

It just so happens that we can, and this ambitious project is being brought to life with GPUtopia. Chris David from the project joins us today to break down the vision and how they hope to play a part in the decentralized future of Ai.

Links mentioned

Tinygrad.org (Link: https://tinygrad.org/)
Inflection.ai (Link: https://inflection.ai/)
Read_712 – Lightning Prisms [DerGigi]⁠ (Link: http://tinyurl.com/28v53jsn)
⁠Read_574 – Lightning & The Internet – Choosing the Right Path [Roy Sheinfeld] (Link: http://tinyurl.com/464xyars)

Guest Links

Christopher David on X (Link: https://twitter.com/AtlantisPleb)
Christopher David on Nostr (Link: http://tinyurl.com/69hcjbkc)
Founder of Open Agents (Link: https://openagents.com/)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)
Don’t forget to follow this podcast in audio as well to get the audible versions of great articles I find in Ai to read and then discuss afterward. (Link: http://tinyurl.com/4mzsa78y)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

Today we delve into a captivating topic, as we explore the potential relationship between AI and evil. My guest Dhruv Bansal brings his profound insights to the forefront as we navigate the depths of this subject.

We contemplate the ethical dilemmas that arise when intelligence is harnessed for destructive purposes, and Dhruv expertly unpacks the intricate interplay between AI intelligence, good, and evil, leaving us with a lot to consider about its impact on our lives and the broader world.

We go deep as we strive to discern the true nature of intelligence and its potential ramifications on our collective humanity.

Guest Links

Dhruv on X (Link: https://twitter.com/dhruvbansal)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

“So we had built this for a while, but because API calls are basically free, there really wasn’t a good match for it. There were some good matches for it and people would do it, but as they were doing it, it was like ‘I can do it this way, but I can also do it with dollars.’ This is kind of a really interesting paradigm when it comes to Ai stuff is that there’s basically 3 or 4 different aspects of Ai that make it so you cannot use credit card relationships to solve the monetization problems there. But you can with Bitcoin and Lightning as it exists today, not requiring any changes to the protocol…”
~ Kody Low

Today we dive into an incredible conversation with Kody Low from Fedi, who is hosting the Ai4All hackathon and believes he has found a solution to an increasingly huge, and seemingly impossible problem within Ai, that you can no longer distinguish human from robot online. What happens when Ai can create an infinite number of new identities? Is this the end of the open internet? find out in this awesome episode.

Links to the content mentioned on the show to check out

Andre Karpathy – Let’s build GPT: from scratch, in code, spelled out (Link: https://www.youtube.com/watch?v=kCc8FmEb1nY⁠⁠)

Brian Roemmelle on X (Link: https://twitter.com/BrianRoemmele)

ChatGPT and the Dawn of Computerized Hyper-Intelligence | Brian Roemmele | EP 357 (Link: https://www.youtube.com/watch?v=S_E4t7tWHUY⁠⁠)

GPT4ALL – A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required (Link: https://gpt4all.io/index.html)

Fedi – Community money, chat, and more (Link: https://www.fedi.xyz/)

Stakwork.ai – With business process automation that integrates an always-on network of cloud sourced workers, it doesn’t have to. | Stakwork | A New Way to Get Work (Link: https://stakwork.ai/)

Join the Hackathon! Follow everything going on in the Ai4All tournament or become a builder yourself (Link: http://tinyurl.com/35yzcn9b)

Guest Links

Kody Low on X (Link: https://twitter.com/kodylow)

Host Links

Guy on Nostr (Link: https://tinyurl.com/yc376bff)
Guy on X (Link: https://twitter.com/theguyswann)
Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible)

Check out our awesome sponsors!

Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠)
Swan: The best way to buy, learn, and earn #Bitcoin