Latest update to Anthropic’s popular AI model also promises improvements for computer use, long-context reasoning, agent planning, knowledge work, and design.

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.