/research

Fin: Running a Reliable Service over Unreliable Parts

Building reliable large language model (LLM) inference is still an emerging discipline. Although the field has matured considerably in recent years, we are far from the level of dependability seen in industry-standard services such as Amazon…

Ketan Bhatt