Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Want to move fast with AI? Open source is the cheat code. Today’s top models already “speak” Kubernetes, SQL and the modern stack.