Introducing "Jackal". What do you think of the interface? I'd like to add integration to email alias services so you can generate a legit email alias. Also need to add the option to generate a login and gpg keys along with an identity.
Been playing with gpt-oss:32B on a friends 16GB Tesla V100. Quite usable actually. We've got another 32GB V100 on the way, will be interesting to see how good of a model we can run.
Those of us that like to tune our open operating systems, our open desktops, our open IDE's, our software, are many steps ahead of those running proprietary operating systems and tools.
The same will happen with AI. Once we start tuning our own models on our own clusters to suit the types of work we are doing, we will be many steps ahead of those using proprietary systems.
I'm seeing a lot of potential for developing bespoke software for small, medium and even large businesses. No longer do they have to pay $60k/year for a piece of generic software that doesn't quite fulfil their needs and leaves inefficiences in their business processes. Now a custom piece of software can be developed rapidly to close the gaps.
If you're a dev or engineer with any sort of pre-AI coding experience, business experience, and any entrepreneurial drive, you are well positioned to take advantage of this paradigm shift that has come with these AI models and tools. I'm getting late 1990's, early 2000s vibes where it felt like endless possibilities.