Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Here is a blueprint for architecting real-time systems that scale without sacrificing speed. A common mistake I see in ...