Skip to content

Pull requests: NVIDIA/FasterTransformer

New pull requestNew
39 Open 130 Closed
39 Open 130 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

fix: fix position_encoding_table memory error.
#791 opened Mar 27, 2024 by johnson-magicLoading…
1
Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.
#773 opened Oct 24, 2023 by FengDSPLoading…
Include stdio.h
#770 opened Oct 19, 2023 by JihaoXinLoading…
2
Ft llama opt
#762 opened Oct 2, 2023 by dypshongLoading…
Support Seq length up to 8K
#756 opened Sep 4, 2023 by zhen-jiaLoading…
[BugFix] GPT inference error when pipeline_para_size > 1 and int8_mode != 0
#750 opened Aug 23, 2023 by 00why00Loading…
[Bugfix] GptJ & GptNeoX batch inference error
#742 opened Aug 11, 2023 by YZP17121579Loading…
1
Add fusion-for-decoder-only for llama
#733 opened Jul 28, 2023 by binxuanLoading…
Fix beam search output_log_prob index error
#732 opened Jul 25, 2023 by cpm0722Loading…
[Doc] Add projects section in README which is developed based on FasterTransformer
#731 opened Jul 25, 2023 by lvhan028Loading…
2
Add triton fastertransformer backend support for deberta
#725 opened Jul 19, 2023 by sfc-gh-zhwangLoading…
1
Add cuDNN include path as a common include dir
#724 opened Jul 18, 2023 by jacobkahnLoading…
fix: initialize tiled_prompt_lengths_buf_ to zero in gptneox
#716 opened Jul 13, 2023 by yandaiLoading…
Remove parenthesis from asserts
#699 opened Jul 2, 2023 by miguelusqueLoading…
Huggingface gptj convert script supports sharded checkpoint
#695 opened Jun 29, 2023 by skyser2003Loading…
[Doc] Fix typo in gpt_guide.md
#682 opened Jun 26, 2023 by myry96Loading…
swin-transformer quantization readme files changes
#675 opened Jun 16, 2023 by MhhhasterLoading…
fix: fix Qk_vec_acum_fp32_ has already been declared
#659 opened Jun 9, 2023 by lkm2835Loading…
gptneox & gptj int8 quantization & share context
#653 opened Jun 7, 2023 by rahuanLoading…
Add missing headers
#648 opened Jun 1, 2023 by brian14708Loading…
Fix TOC of gptneox_guide.md
#633 opened May 23, 2023 by xu-songLoading…
Update gpt_guide.md: documentation link is invalid
#620 opened May 22, 2023 by treychengLoading…
fix multi-gpu build
#616 opened May 17, 2023 by dskhudiaContributorLoading…
1
Fix mpi library linking issue
#612 opened May 16, 2023 by liangfuLoading…
remove buggy duplicated code
#609 opened May 12, 2023 by chenho74Loading…
1
ProTip! Exclude everything labeled bug with -label:bug.