unixmonks

Social media ban has just gone into effect for under 16s in Australia. Will nostr become the new cool platform for kids?

Tesla V100 32GB in hand from China. Should be able to run 30B models locally with this. Goal is to have 2 of these so we can run 70B models.

Coming up with a business name is harder than creating the business

Introducing "Jackal". What do you think of the interface? I'd like to add integration to email alias services so you can generate a legit email alias. Also need to add the option to generate a login and gpg keys along with an identity.

Been playing with gpt-oss:32B on a friends 16GB Tesla V100. Quite usable actually. We've got another 32GB V100 on the way, will be interesting to see how good of a model we can run.