Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
From IDE plugins to external chatbots and running LLMs locally, these new and emerging tools are bringing the generative AI revolution to R. My previous article focused on some of the best tools for ...