Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Using large-language models to get medical advice and make medical decisions is a risky practice, a new study has warned. The ...