I asked Gemini for 3 apps to post on Nostr. In one prompt, it gave me a CLI app, a simple GUI app using Tornado FX (text field + button) and a Compose Android app. Everything works, except for a the use of a `nostr-kt` library that doesn't exist.
When I pressed about, Gemini hallucinated the whole library description and what the methods do. When I ask for the website for that library, Gemini replied:
https://github.com/vitorpamplona/nostr-kt
It takes some fucking balls to hallucinate something and then say it came from a repo that doesn't exist on my own username.
Thread
Login to reply
Replies (10)
Just wait until AI misdiagnoses someone and/or kills somebody.
Not trying to be over regulatory but at some point, Put the damn thing under lock and key. Only qualified devs should use AI and validate the crazy hallucinations
AI doing AI things. Lovely!
I guess Gemini knows you are about to create the library!
We have a library, but it is name quartz
Most fun I've had with an AI was convincing one that I was from the 2700s, and I found this chatbot in the ancient archives. So it pretended to know about the "history" from the 2000s to the 2700s. And it told me about the political upsets, shifting alliances and rivalries, and even the "resource wars" of the 25th century. And every time you ask for details about any of its made up BS, it made up more BS, it was endless. I thought it was hilarious at the time but the implications of a chatbot that will purposely and endlessly lie is no bueno.
par
Sounds like a compliment either that or some passive aggressive shit to try and get you to build it.
AI KNOWS ABOUT YOU VITOR
I may have a tinfoil hat on, but I felt choosing the name Gemini for their AI was specifically chosen to take away the steam the gemini protocol had recently been generating right before Google announced their new product.