• 0 Posts
  • 14 Comments
Joined 2 years ago
cake
Cake day: August 4th, 2023

help-circle

  • The programs usually mmap the file into memory. That means that parts of it are loaded as used and unloaded if there is no memory left. That’s why it does not say it is using memory. Check disc i/o as it is generating the message. For linux that can be seen in htop or iotop, for win idk.

    Note that I use lmstudio, that uses llama.cpp to run models. Gpt4all, I think, uses a modified version of same. Doesn’t matter they should all be using mmap to load the file.

    PS Depending on the model I also get a couple tokens per sec on the cpu.

    Edit: Didn’t see someone already said the same, I’l leave this here anyway.






  • Yea. DNS is just an address book (name to IP). There’s a bit more to how it is structured, but it’s not that complicated.

    Actually thinking about it, they would not have to remove the “domain” (tiktok.com or whatever it is), they (tiktok) would just have to stop using it for business. They could like put a banner that says “tiktok is no longer avalible here” or whatever.

    Other part is IP. As you said, you could just change what dns server your phone asks for IPs and use it like normal. The government could block the IP at the big nodes going out of the country. Then you would have to use a vpn. Idk what they (usa or tiktok) have done, but I know tiktok will not actively try to skirt around it and will remove themselves. I would expect someone stupid like musky to try something, but big companies are usually serious.

    Anyway, they can’t stop vpns. But vpns are a pain for regular folk.