• 1 Post
  • 215 Comments
Joined 2 years ago
cake
Cake day: August 4th, 2023

help-circle
  • The programs usually mmap the file into memory. That means that parts of it are loaded as used and unloaded if there is no memory left. That’s why it does not say it is using memory. Check disc i/o as it is generating the message. For linux that can be seen in htop or iotop, for win idk.

    Note that I use lmstudio, that uses llama.cpp to run models. Gpt4all, I think, uses a modified version of same. Doesn’t matter they should all be using mmap to load the file.

    PS Depending on the model I also get a couple tokens per sec on the cpu.

    Edit: Didn’t see someone already said the same, I’l leave this here anyway.












  • The smallest particles are not actually balls, but are wibbly wobbly. To measure something we need to interact with it, even if we interact with it using light. But because those particles are all wibbly wobbly, we can’t say for sure where they are exactly. And that unsure distance is Plancks length.

    Disclaimer; I am not theoretical not a physicist, now eat your vegetables.