Skip to content

Pull requests: ModelTC/LightLLM

New pull requestNew
52 Open 1,136 Closed
52 Open 1,136 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

fix: bump tiktoken to 0.8.0 for litellm 1.84.8
#1430 opened Aug 4, 2026 by sufubaoCollaboratorLoading…
1
fix(api): harden OpenAI streaming/non-streaming error handling
#1426 opened Aug 4, 2026 by sufubaoCollaboratorLoading…
1
feat(pd): balance heterogeneous prefill load by input tokens
#1425 opened Aug 4, 2026 by sufubaoCollaboratorLoading…
1
perf(pd): reduce qwen3next prefill linear-att state memory
#1421 opened Aug 4, 2026 by sufubaoCollaboratorLoading…
1
fix(multinode): use JSON instead of pickle for node-IP exchange to prevent RCE
#1419 opened Aug 2, 2026 by Anai-GuoLoading…
1
1
fix(qwen3.5): restore BF16 attention gate semantics for RL consistency
#1415 opened Jul 30, 2026 by shihaobaiCollaboratorLoading…
1
fix: clean up shared memory on process exit
#1414 opened Jul 30, 2026 by sufubaoCollaboratorLoading…
1
feat: support Kimi K3
#1410 opened Jul 28, 2026 by sufubaoCollaboratorLoading…
1
feat: add FlashQLA GDN prefill backend
#1408 opened Jul 27, 2026 by sufubaoCollaboratorLoading…
1
fix: quarantine PD pages until transfer quiesces
#1406 opened Jul 27, 2026 by sufubaoCollaboratorLoading…
1
feat: fuse post-attention all-reduce and RMSNorm
#1405 opened Jul 27, 2026 by sufubaoCollaboratorLoading…
1
fix(security): 2 improvements across 1 files
#1401 opened Jul 23, 2026 by tomaiooLoading…
1
fix: reduce memory occupation and raise performance for multi-nodes
#1396 opened Jul 17, 2026 by blueswhenCollaboratorLoading…
7
fix: fix bugs in the ep v2 and mega moe for sm100
#1392 opened Jul 15, 2026 by blueswhenCollaboratorLoading…
3
feat: gc.freeze hot processes and disable gc during cudagraph capture
#1382 opened Jul 5, 2026 by sufubaoCollaboratorLoading…
5
Support GLM-5.2 (glm_moe_dsa, DeepSeek-V3.2-style DSA MoE)
#1370 opened Jun 25, 2026 by sufubaoCollaboratorLoading…
5
feat: fuse add and rmsnorm
#1368 opened Jun 24, 2026 by blueswhenCollaboratorLoading…
3
fix(sampling_params): validate token-id input types via a shared helper
#1365 opened Jun 19, 2026 by SuperMarioYLContributorLoading…
8
Support default chat template kwargs
#1363 opened Jun 18, 2026 by sufubaoCollaboratorLoading…
2
fix(moe): avoid cross-warp stale read in ep_scatter prefix sum
#1362 opened Jun 16, 2026 by Anai-GuoLoading…
1
3
support ds4
#1355 opened Jun 15, 2026 by WANDY666ContributorLoading…
2
feat: add gguf support
#1354 opened Jun 15, 2026 by zhangts20CollaboratorLoading…
14
test(sampling_params): repair broken test collection and add verify() coverage
#1350 opened Jun 13, 2026 by SuperMarioYLContributorLoading…
7
feat: add multi-platform support with ascend and maca
#1335 opened Jun 8, 2026 by zhangts20CollaboratorLoading…
8
feat: update disk cache params and benchmark_multiturn.py
#1333 opened Jun 8, 2026 by blueswhenCollaboratorLoading…
3
ProTip! Adding no:label will show everything without a label.