vllm Announces Release v0.30.0rc1 with Bugfix for FlashInfer BF16 Autotuning
vllm has released version v0.30.0rc1, which includes a bugfix to isolate supplemental FlashInfer BF16 autotuning.
vllm has announced the release of version v0.30.0rc1, which includes a bugfix to isolate supplemental FlashInfer BF16 autotuning. The release is aimed at improving the stability and performance of the FlashInfer BF16 autotuning feature. This update is part of ongoing efforts to enhance the functionality and reliability of the vllm project.
Source: gh-vllm
