Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
The fixedpoint package is a fixed point arithmetic library for python, released under the BSD license. Install fixedpoint with pip install fixedpoint. Post- and development-releases are not supported.