Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Americans are living in parallel AI universes. For much of the country, AI has come to mean ChatGPT, Google’s AI overviews, ...