This also has improvements for #koboldcpp (whole llamacpp ecosystem) users who have RDNA3/4 with very big coopmat prompt processing improvements on par with rocm. Once it lands in the Kisak PPA I will add it to our docker for those who can't easily install it natively and those who prefer using the container. View quoted note →

I always say the EU is "Now or later", as with Chat Control never was never an option. Rushed trough in an even worse form. Hopefully we stop it along the way, but I have serious fears for my freedom. Nostr is a shield, but as someone who heavily relies on the internet for social interactivity due to a disability i'd fear i'd miss out on vital oppertunities by only being able to post here so if people don't either stop it or migrate to these kinds of places ill be forced to ID verify, be very careful about what I say on those platforms and then persuade those contacts to add me on a privacy respecting platform asap.