Defeating Nondeterminism in LLM Inference
Link: thinkingmachines.ai/blog/defea…
Discussion: news.ycombinator.com/item?id=4…
Defeating Nondeterminism in LLM Inference
Reproducibility is a bedrock of scientific progress. However, it’s remarkably difficult to get reproducible results out of large language models.Thinking Machines Lab
The Felon Pope
in reply to Trending • • •