Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...

Goose acts as the agent that plans, iterates, and applies changes. Ollama is the local runtime that hosts the model. Qwen3-coder is the coding-focused LLM that generates results. If you've been ...