

Very cool! I got it running. Though apparently I didn’t need step 6 as it started running after I downloaded it. I was a bit confused, and do was the LLM as it started telling me how the run command works 🤦♂️
Good fun. Got me interested in running local LLM for the first time. What type of performance increase should I expect when I spin this up on my 3070 ti?
Somewhere between 4 to 8, depending on how productive we are in the morning.