I did a deep dive on current embedding sizes and architectures
How big are our embeddings now and why?
Embedding sizes and architectures have changed remarkably over the past 5 years
Vicki Boykis
Vicki Boykis
vicki_at_jawns.club@momostr.pink
npub1fznf...nnyk
#Recsys. #MachineLearning. #Engineering and distributed systems. Python, the JVM, and two small children. Writing. Terrible puns. Nutella
website: https://vickiboykis.com/
github: https://github.com/veekaybee
normconf: http://www.normconf.com
location: Philadelphia
In the hyperbolic discussions around AI, it's easy to forget that you can get it to do extremely useful, constrained tasks in development workflows. I wrote post about how one of my favorite smol AI tools, Full line code completion in JetBrains products, works.
My favorite use-case for AI is writing logs
One of my favorite AI dev products today is Full Line Code Completion in PyCharm (bundled with the IDE since late 2023). It’s extremely well-thou...
It's been feeling like the local LLM space has really slowed over the past 6 months, curious if it's just me or others have felt it too. If you're using local models, which ones and for what?