<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>My video card isn't 128 gb, I wouldn't have done that (also don't
know that those exist, even in the A100 models). Ram was cheaper
when I bought it, so it sounds more impressive than it really is.
now if I say I bought 128 gb for my home server people think I'm
the musky Elmo because data centers are gobbling up ram and
sending prices through the roof.</p>
<div class="moz-signature">
<div>
<p>
<strong>Ty Littlefield (he/him/his)</strong><br>
</p>
<ul>
<li> <a href="https://tysdomain.com" target="_blank">From
Bytes to Bites</a>|
</li>
<li><a href="https://www.linkedin.com/in/ty-lerlittlefield/">Linkedin</a>|</li>
<li><a href="https://github.com/tlfdev">Github</a></li>
</ul>
</div>
</div>
<div class="moz-cite-prefix">On 5/21/2026 7:05 AM, Lewis Wood via
NFBCS wrote:<br>
</div>
<blockquote type="cite"
cite="mid:008e01dce922$8fa3f880$aeebe980$@gmail.com">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta name="Generator"
content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas",serif;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:18702395;
mso-list-template-ids:480525662;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:\uf0b7;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1
{mso-list-id:1045132496;
mso-list-template-ids:519749222;}
@list l1:level1
{mso-level-number-format:bullet;
mso-level-text:\uf0b7;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l1:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l1:level3
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level4
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level5
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level6
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level7
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level8
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1:level9
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2
{mso-list-id:1869836163;
mso-list-template-ids:-2014125254;}
@list l2:level1
{mso-level-number-format:bullet;
mso-level-text:\uf0b7;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l2:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l2:level3
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level4
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level5
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level6
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level7
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level8
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l2:level9
{mso-level-number-format:bullet;
mso-level-text:\uf0a7;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">WOW, You
guys make my proposed little purchase of a 16gb nvidia card
very small. 128gb are very expensive in the very least. I
refuse to go above $1,000.00.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I currently
have 32gb ddr Windows Lenova computer with a 4gb nvidia
t1000 card.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I figured
adding a 166gb nvidia card would give me 20gb of vram total.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I may not be
able to run the very 70b models, but I think the smaller
should do for 20gb vram and 32gb ddr ram.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I am
thinking it will run most, I can always offshore some larger
tasks to online providers (clawd or co-pilot).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I am just a
newbie so any advise is quite welcome.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Lewis Wood<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div>
<div
style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">
NFBCS <a class="moz-txt-link-rfc2396E" href="mailto:nfbcs-bounces@nfbnet.org"><nfbcs-bounces@nfbnet.org></a> <b>On Behalf Of
</b>Elijah Massey via NFBCS<br>
<b>Sent:</b> Thursday, May 21, 2026 3:04 AM<br>
<b>To:</b> <a class="moz-txt-link-abbreviated" href="mailto:nfbcs@nfbnet.org">nfbcs@nfbnet.org</a><br>
<b>Cc:</b> Elijah Massey <a class="moz-txt-link-rfc2396E" href="mailto:emassey0135@gmail.com"><emassey0135@gmail.com></a><br>
<b>Subject:</b> Re: [NFBCS] Local AI<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I tried running local LLMs for a while on
my Ryzen AI 9 HX 370 mini PC with 32 GB of RAM, on Arch Linux
with Ollama. It was very slow at first until I got the Ollama
Vulkan backend working and it started using the iGMU, and then
it became pretty fast (at least 20 or 30 tokens per second I
think). I was using 13B models mostly because that's what fit
in my 32 GB of RAM. I did not need to increase my VRAM for it
to be fast like this and it was set to 4 GB by default,
although I heard there is a mechanism for dynamically
increasing RAM that the iGPU can access somehow. However,
there were definitely limitations compared to the cloud
models. I noticed that the context window on the local models
I tried was always shorter so it would have trouble
remembering earlier messages in the conversation, and the
cloud models just often created better responses and better
did what I asked. I think it would be better if I have more
RAM so I could run 70b models or larger. By the way, if you
want to run local LLMs, I think an Apple Silicon Mac with a
lot of RAM would be a great option, because of their unified
memory. The GPU and NPU can access all of the RAM which is
very good for local AI. Also, I would get the Max chips over
the Pro can they have double the GPU cores and support higher
RAM. I'm waiting for the M6 Max MacBook Pro/Ultra to come out
later this year and then I'll probably get that.<o:p></o:p></p>
<div>
<p class="MsoNormal">Sent from my iPhone<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal" style="margin-bottom:12.0pt">On May 21,
2026, at 02:02, Ty Littlefield via NFBCS <<a
href="mailto:nfbcs@nfbnet.org" moz-do-not-send="true"
class="moz-txt-link-freetext">nfbcs@nfbnet.org</a>>
wrote:<o:p></o:p></p>
</blockquote>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span
style="font-family:"Tahoma",sans-serif">\ufeff</span>
<o:p></o:p></p>
<p>I agree with this. I bought a data center quality GPU for
fun and testing. It's a referb, and I have 128 gb ram and
I'm running everything off of em.2 drives. Even with that
much ram, context windows don't last as long as the
fronteer models. I suspect that the fronteer models are
cramming everything into vector db type data storage
services and using something to prefetch data when needed,
but I could be very wrong there.<o:p></o:p></p>
<p>Just in raw performance, I got a lot of this stuff cheap
and on sale. It would cost probably 3x the amount if not
more right now. You need a minimum of 64 gb ram, and
that's on the low end.<o:p></o:p></p>
<p><o:p> </o:p></p>
<p>It's worth doing, but you might do better at these
current prices buying a beefed up Mac server vs trying to
build your own system.<o:p></o:p></p>
<p><o:p> </o:p></p>
<p class="MsoNormal">On 5/20/2026 11:35 PM, Paul York via
NFBCS wrote:<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">I've
been knee deep in local llm setup for the better
part of the last two weeks. To give you
perspective on my hardware, I'm playing with two
moderately beefy "consumer" machines: a Windows
11-based Ultra 7, 64GB RAM, RTX 4070 w/ 12GB VRAM
and a linux-based Ryzen AI 9 HX370 mini pc with
64GB RAM (both bought before prices went bonkers
thankfully).<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">TLDR:
I'm keeping my Claude and Gemini subscriptions.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">I
think a longer discussion will hinge on what you
want to do with it. Are you programming? Running
OpenClaw/agentic stuff? Just chatting? Creating
documents and presentations? Doing NotebookLM kind
of things? Because here's the deal. After a LOT of
tweaking, I'm getting:<o:p></o:p></span></p>
</div>
<div>
<ul type="disc">
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l2 level1 lfo1"><span
style="font-size:18.0pt">around 25 tokens per
second output on my iGPU (Ryzen) using some
pretty high quality models (Qwen 3.6 35b and
Gemma 4 26b) by pushing the VRAM up to 48GB.<o:p></o:p></span></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l2 level1 lfo1"><span
style="font-size:18.0pt">anywhere between 65 and
95 tokens per second output on my RTX GPU using
much lower quality models (Qwen 3.5 9b and Gemma
4 4b).<o:p></o:p></span></li>
</ul>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">In
both cases, if I don't take steps to optimize
the model such that it stays 100% in VRAM, it
slows to an entirely unusable rate.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">UP
FRONT WARNING--I'm a noob with this, so take my
explanation with a grain of salt.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">What
does that actually mean? Well especially if you
use a "reasoning" model like Qwen, then a simple
query response (like "tell me a funny dad joke")
can take up to a minute to respond. This is
because approximately every word of every
"thought" is an output token. It "talks to
itself" until if decides it has found a
reasonable answer. And it adds up quick. Here
are some basic results for this exact query on
all 4 models / hardware:<o:p></o:p></span></p>
</div>
<div>
<ul type="disc">
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l1 level1 lfo2"><span
style="font-size:18.0pt">Qwen on RTX 4070:
required 1200 tokens and 18 seconds to respond<o:p></o:p></span></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l1 level1 lfo2"><span
style="font-size:18.0pt">Gemma on RTX 4070:
required 300 tokens and 3.5 seconds to respond<o:p></o:p></span></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l1 level1 lfo2"><span
style="font-size:18.0pt">Qwen on iGPU:
required 630 tokens and 23 seconds to respond<o:p></o:p></span></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l1 level1 lfo2"><span
style="font-size:18.0pt">Gemma on iGPU:
required 450 tokens and took 18 seconds to
respond<o:p></o:p></span></li>
</ul>
<div>
<p class="MsoNormal"><span
style="font-size:18.0pt">Again that's
moderately beefy hardware and a lot of
tweaking. But I could also do far better if I
accepted much dumber models. Which may be just
find for basic agentic work. But much less
good for coding or reasoned synthesis. And the
"smartest" model took 23 seconds to reason
through a dad joke. 7 seconds just to figure
out how to respond to "hello". Working on
truly complex reasoning can take a
bathroom+coffee break to give you back
results.<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">Note
too that this doesn't take into account context
size and context caching. Context is the LLM's
active memory. Models have maximums (I think
they are tuned for these sizes). But in most
cases you'll likely have to accept something
lower. However, to be even moderately useful for
much of anything, you can't go terribly low.
Coding tools and agentic tools just blow up if
they can't remember things from one thought to
the next.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">The
numbers I'm getting on the RTX are decent.
Almost usable. BUT the context sizes to achieve
that make it basically unusable for the kind of
work I want to do. If I bump up the context
window to a usable level with these models, I
leak out into RAM (far slower than VRAM) and my
performance tanks to unusable levels (like <
5-10 tps...at least 80-90% or more slower).<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">The
iGPU with huge VRAM is slower than the dedicated
GPU, but because I can crank up the context
window, they actually become usable for what I
want to use them for. However...speed. Claude
Sonnet or Gemini Flash are easily 10x faster at
everything. And more like 20x-30x faster for
most reasoning work. So at some point it's a
question of how much you value your time.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">I
will be using local models for some basic stuff,
I think. I'm starting down a personal knowledge
management path with AnythingLLM or something
similar. I think it'll pair perfectly with this.
And I'll likely find more ways to leverage it.
But I won't be abandoning the big boys any time
soon.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">And
sadly, although your Ultra 7 w/ 32GB RAM is an
awesome PC, I fear your experience with local
llms for anything other than experimentation and
learning will prove frustratingly slow. And with
prices the way they are right now, getting your
PC spec'd to perform moderately well will
certainly cost around the same as a full year of
one of the "ultimate" plans.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">Hope
this was helpful. And that I didn't show my
ignorance too badly.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">Best,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt">Paul
York<o:p></o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Wed, May 20, 2026 at 11:35<span
style="font-family:"Arial",sans-serif">\u202f</span>PM
Lewis Wood via NFBCS <<a
href="mailto:nfbcs@nfbnet.org" target="_blank"
moz-do-not-send="true"
class="moz-txt-link-freetext">nfbcs@nfbnet.org</a>>
wrote:<o:p></o:p></p>
</div>
<blockquote
style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">I am currently
learning as well.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">I am now doing
Ollama playlist lessons #2 currently.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"><a
href="https://www.youtube.com/playlist?list=PLvsHpqLkpw0fIT-WbjY-xBRxTftjwiTLB"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">https://www.youtube.com/playlist?list=PLvsHpqLkpw0fIT-WbjY-xBRxTftjwiTLB</a></span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">I did my initial
research on Lm Studio before I learned about
Ollama CLI</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">This was my first
Lm Studio and it was an excellent one
regarding resources, models, agents, etc.
Even discussed how to load partial in
differing areas gpu and ddr.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"><a
href="https://www.youtube.com/watch?v=UngVdAsQEiU" target="_blank"
moz-do-not-send="true"
class="moz-txt-link-freetext">https://www.youtube.com/watch?v=UngVdAsQEiU</a></span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">You can search
youtube \u201clm studio\u201d</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">Lewis Wood</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<div>
<div
style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0in 0in 0in;border-color:currentcolor currentcolor">
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">
NFBCS <<a
href="mailto:nfbcs-bounces@nfbnet.org"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">nfbcs-bounces@nfbnet.org</a>>
<b>On Behalf Of </b>Joe Orozco via
NFBCS<br>
<b>Sent:</b> Wednesday, May 20, 2026
10:08 PM<br>
<b>To:</b> 'NFB in Computer Science
Mailing List' <<a
href="mailto:nfbcs@nfbnet.org"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">nfbcs@nfbnet.org</a>><br>
<b>Cc:</b> Joe Orozco <<a
href="mailto:jsorozco@gmail.com"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">jsorozco@gmail.com</a>><br>
<b>Subject:</b> [NFBCS] Local AI</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">Hello,</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">With Google
following in Claude\u2019s footsteps in terms of
usage restrictions, can anyone speak to
their experience using local LLM options?
I\u2019m looking at Jemma 4 and trying to
understand how accessible this route might
be with JAWS on Windows.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">I\u2019m on a fairly
decent machine: 32 GB RAM, Ultra 7
processor, 4 TB SSD. I see they\u2019re
recommending GPU for some of the more robust
models, but I want to think most of what I\u2019m
doing shouldn\u2019t require gaming machine
specs. If you beg to differ though, let me
know.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">If anyone can speak
to Jemma alternatives, I\u2019d also be
interested. I don\u2019t think I\u2019ll suspend my
subscriptions, but with these usage
limitations feeling like the new standard, I
want to spread my usage a little so that I
don\u2019t feel like I need to be hitting the top
subscriptions just to get more mileage out
of the five-hour increments.</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">Thanks in advance
for any tips,</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt">Joe</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-family:"Times New Roman",serif">--</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-family:"Times New Roman",serif">Joe Orozco: Your
Message, My Mission</span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span
style="font-family:"Times New Roman",serif"><a
href="https://joeorozco.com/services/"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">https://joeorozco.com/services/</a></span><o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
NFBCS mailing list<br>
<a href="mailto:NFBCS@nfbnet.org" target="_blank"
moz-do-not-send="true"
class="moz-txt-link-freetext">NFBCS@nfbnet.org</a><br>
<a
href="http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org</a><br>
To unsubscribe, change your list options or get
your account info for NFBCS:<br>
<a
href="http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/paul%40yorkfamily.com"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/paul%40yorkfamily.com</a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>NFBCS mailing list<o:p></o:p></pre>
<pre><a href="mailto:NFBCS@nfbnet.org"
moz-do-not-send="true" class="moz-txt-link-freetext">NFBCS@nfbnet.org</a><o:p></o:p></pre>
<pre><a
href="http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org"
moz-do-not-send="true" class="moz-txt-link-freetext">http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org</a><o:p></o:p></pre>
<pre>To unsubscribe, change your list options or get your account info for NFBCS:<o:p></o:p></pre>
<pre><a
href="http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/tyler%40tysdomain.com"
moz-do-not-send="true" class="moz-txt-link-freetext">http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/tyler%40tysdomain.com</a><o:p></o:p></pre>
</blockquote>
<div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<p><strong><span
style="font-family:"Aptos",sans-serif">Ty
Littlefield (he/him/his)</span></strong><o:p></o:p></p>
<ul type="disc">
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo3"><a
href="https://tysdomain.com" target="_blank"
moz-do-not-send="true">My Website</a>| <o:p></o:p></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo3"><a
href="https://www.linkedin.com/in/ty-lerlittlefield/"
moz-do-not-send="true">Linkedin</a>|<o:p></o:p></li>
<li class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo3"><a
href="https://github.com/tlfdev"
moz-do-not-send="true">Github</a><o:p></o:p></li>
</ul>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
NFBCS mailing list<br>
<a href="mailto:NFBCS@nfbnet.org" moz-do-not-send="true"
class="moz-txt-link-freetext">NFBCS@nfbnet.org</a><br>
<a
href="http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org"
moz-do-not-send="true" class="moz-txt-link-freetext">http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org</a><br>
To unsubscribe, change your list options or get your
account info for NFBCS:<br>
<a
href="http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/emassey0135%40gmail.com"
moz-do-not-send="true" class="moz-txt-link-freetext">http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/emassey0135%40gmail.com</a><o:p></o:p></p>
</div>
</blockquote>
</div>
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre wrap="" class="moz-quote-pre">_______________________________________________
NFBCS mailing list
<a class="moz-txt-link-abbreviated" href="mailto:NFBCS@nfbnet.org">NFBCS@nfbnet.org</a>
<a class="moz-txt-link-freetext" href="http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org">http://nfbnet.org/mailman/listinfo/nfbcs_nfbnet.org</a>
To unsubscribe, change your list options or get your account info for NFBCS:
<a class="moz-txt-link-freetext" href="http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/tyler%40tysdomain.com">http://nfbnet.org/mailman/options/nfbcs_nfbnet.org/tyler%40tysdomain.com</a>
</pre>
</blockquote>
</body>
</html>