You make a good point here -- I have a theory that LLM's are going to creep into more and more applications in the role of "reasoning engines" (don't have a better term yet) but the lack of deterministic output could cause a whole new set of challenges. If the same question always yielded the same answer it would be less of an issue (determinism)... but the models currently yield *at least* different structure in each response... if not a completely different answer altogether.
You make a good point here -- I have a theory that LLM's are going to creep into more and more applications in the role of "reasoning engines" (don't have a better term yet) but the lack of deterministic output could cause a whole new set of challenges. If the same question always yielded the same answer it would be less of an issue (determinism)... but the models currently yield *at least* different structure in each response... if not a completely different answer altogether.