Update ptxla training - #9864

Merged

yiyixuxu merged 20 commits into

huggingface:mainfrom

entrpn:update_ptxla_training

Dec 6, 2024

Commits on Nov 1, 2024

update ptxla example
jfacevedo-google
committed
f04ee1d
update ptxla example based on Pei's comments.
jfacevedo-google
committed
96af06e

Commits on Nov 4, 2024

add print loss cli argument. Run make style and quality.
jfacevedo-google
committed
6234a37
make measure_start_step an argument.
jfacevedo-google
committed
b516134
use PORT variable across the script.
jfacevedo-google
committed
8c47f35

Commits on Nov 5, 2024

Merge branch 'main' into update_ptxla_training
zpcore
authored
10b6ba1

Commits on Nov 28, 2024

split out xla flash attention from base AttnProcessor
zpcore
committed
8b3cbb1
Merge branch 'main' into update_ptxla_training
zpcore
authored
6c74c79

Commits on Nov 29, 2024

use version check for torch_xla
zpcore
committed
2c00cbd
Merge branch 'main' into update_ptxla_training
zpcore
authored
5969ce4

Commits on Dec 3, 2024

setup the option to use xla flash attention or not
zpcore
committed
fb29e37
Merge branch 'main' into update_ptxla_training
zpcore
authored
46baa56
naming nit
zpcore
committed
df31c9d

Commits on Dec 4, 2024

Merge branch 'main' into update_ptxla_training
sayakpaul
authored
f1ade2e
format fix with ruff cmd
Pei Zhang
authored and
Pei Zhang
committed
ff332e6

Commits on Dec 6, 2024

adding warning message
zpcore
committed
dbe4725
format fix with ruff cmd
Pei Zhang
authored and
Pei Zhang
committed
c012faf
Merge branch 'main' into update_ptxla_training
zpcore
authored
0225ed7
make style
hlky
committed
03089f5
Merge branch 'main' into update_ptxla_training
hlky
authored
719fcf9