✨ LMCache v0.5.7.post1 is now available, with safer defaults, more accelerators, and native gRPC.
The official Docker images now run as the non-root user lmcache (UID 1000). The MP HTTP server, the frontend HTTP API, and the coordinator gain optional API key authentication. It stays off until you configure a key with --api-key-file.
Biren SUPA and Cambricon MLU are new platforms, and the gRPC MP transport adds native and asyncio server modes. Packages are built against PyTorch 2.14.0.
This release includes work from 34 new contributors. Thank you, and welcome.
âš™ Before you upgrade: make sure UID 1000 can read and write every path LMCache uses, including mounted volumes.
na2.hubs.ly/H093XcG0
#LMCache #KVCache
The official Docker images now run as the non-root user lmcache (UID 1000). The MP HTTP server, the frontend HTTP API, and the coordinator gain optional API key authentication. It stays off until you configure a key with --api-key-file.
Biren SUPA and Cambricon MLU are new platforms, and the gRPC MP transport adds native and asyncio server modes. Packages are built against PyTorch 2.14.0.
This release includes work from 34 new contributors. Thank you, and welcome.
âš™ Before you upgrade: make sure UID 1000 can read and write every path LMCache uses, including mounted volumes.
na2.hubs.ly/H093XcG0
#LMCache #KVCache