Are you able to do prompt caching with Anthropic? From what I’ve heard costs go down a lot when you can do this.
Thread
Login to reply
Replies ()
I did try it. It didn't have much of an impact. Big AI companies are subsidizing cost. There are things we can do in Shakespeare but they have downsides.