When you think about it, LLM APIs (that we use everyday) are non-deterministic APIs :)
I think this direction is inevitable, but we shouldn't probably worry too much. After all, humans are non-deterministic by definition, but we still work with them!
It's like when you call a provider three times and three operators give you a different response. At some point, you'll be happy one person gave you the response you like, but then hold him/her accountable for that, it's another story ...
I would NEVER implement a non deterministic API. There are too many things that can go wrong, both by chance and by malevolous intentions...
When you think about it, LLM APIs (that we use everyday) are non-deterministic APIs :)
I think this direction is inevitable, but we shouldn't probably worry too much. After all, humans are non-deterministic by definition, but we still work with them!
It's like when you call a provider three times and three operators give you a different response. At some point, you'll be happy one person gave you the response you like, but then hold him/her accountable for that, it's another story ...
Fascinating read! I’m Harrison, an ex fine dining line cook. My stack "The Secret Ingredient" adapts hit restaurant recipes for easy home cooking.
check us out:
https://thesecretingredient.substack.com