Major upgrades to Ray Serve: 88% lower latency and 11.1x higher throughput

by robertnishihara | View on Hacker News