unixmonks

Social media ban has just gone into effect for under 16s in Australia. Will nostr become the new cool platform for kids?

Tesla V100 32GB in hand from China. Should be able to run 30B models locally with this. Goal is to have 2 of these so we can run 70B models.

Coming up with a business name is harder than creating the business

Introducing "Jackal". What do you think of the interface? I'd like to add integration to email alias services so you can generate a legit email alias. Also need to add the option to generate a login and gpg keys along with an identity.

Been playing with gpt-oss:32B on a friends 16GB Tesla V100. Quite usable actually. We've got another 32GB V100 on the way, will be interesting to see how good of a model we can run.

vibe right now

Those of us that like to tune our open operating systems, our open desktops, our open IDE's, our software, are many steps ahead of those running proprietary operating systems and tools. The same will happen with AI. Once we start tuning our own models on our own clusters to suit the types of work we are doing, we will be many steps ahead of those using proprietary systems.