The features section highlights the Metal inference backend for Apple M1/M2, StarCoder model series support, and experimental support of HTTP API backend. The improvements section mentions an enhancement in default suffix handling in FIM inference. Lastly, the new contributors section acknowledges the first contributions of @sunny0826 and @leiwen83.
Key takeaways:
- Homebrew support is now available for Apple M1/M2 users to install TabbyML.
- Artifacts available include binaries for Mac OSX M1/M2 and Linux x86/64, as well as a Docker image with NVIDIA CUDA Support.
- New features include a Metal inference backend for Apple M1/M2, StarCoder model series support, and experimental support of http api backend.
- Improvements have been made in default suffix handling in FIM inference.