• 2 Posts
  • 368 Comments
Joined 2 years ago
cake
Cake day: July 21st, 2023

help-circle
  • In my experience anything similar to qwen-2.5:32B comes closest to gpt-4o. I think it should run on your setup. the 14b model is alright too, but definitely inferior. Mistral Small 3 also seems really good. anything smaller is usually really dumb and I doubt it would work for you.

    You could probably run some larger 70b models at a snails pace too.

    Try the Deepseek R1 - qwen 32b distill, something like deepseek-r1:32b-qwen-distill-q4_K_M (name on ollama) or some finefune of it. It’ll be by far the smartest model you can run.

    There are various fine tunes that remove some of the censorship (ablated/abliterated) or are optimized for RP, which might do better for your use case. But personally haven’t used them so I can’t promise anything.




















  • DavidGarcia@feddit.nltomemes@lemmy.world...
    link
    fedilink
    arrow-up
    18
    arrow-down
    1
    ·
    1 month ago

    I don’t understand how anyone can buy a Tesla. The lack of a dashboard + the only interface being a tablet alone are a deal breaker for me.

    You’re being sold a feature that is really just massive cost cuttings playing impostor as a luxury feature at a premium with 100x worse usability.