Skip to content

feat(scheduler): support mixed prefill and decode batching - #624

Open
Simon12345777 wants to merge 3 commits into
InfiniTensor:mainfrom
Simon12345777:feat/mixed-prefill-decode
Open

Simon12345777 wants to merge 3 commits into
InfiniTensor:mainfrom
Simon12345777:feat/mixed-prefill-decode

fix(scheduler): disable mixed batching with KV connectors and warn wh…

8111862
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs