Skip to content

Fix bugs and improve performance - #20

Open
sldyns wants to merge 1 commit into
JackieHanLab:mainfrom
sldyns:main
Open

Fix bugs and improve performance#20
sldyns wants to merge 1 commit into
JackieHanLab:mainfrom
sldyns:main

Conversation

@sldyns

Copy link
Copy Markdown
  1. Resolved the issue of continuous GPU memory growth by altering weights = attn to weights = attn.detach().
  2. Enhanced execution speed, decreasing memory consumption, by substituting the masked Multi-Layer Perceptron (MLP) operation within FeatureEmbed with sparse matrix multiplication via the creation of a new SparseLinear class.
  3. No need for torch==1.7.1, it works perfectly with torch==2.1.0.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@sldyns