Skip to content

repeat: split cols against every constraint the BD imposes, and add test coverage - #161

Merged
andrej merged 3 commits into
amd:develfrom
atassis:pr/repeat-tests
Aug 29, 2026
Merged

repeat: split cols against every constraint the BD imposes, and add test coverage#161
andrej merged 3 commits into
amd:develfrom
atassis:pr/repeat-tests

Conversation

@atassis

@atassis atassis commented Aug 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Stacked on #157: the new tests gate at exact equality, which #157 is what makes
expressible. Its two commits are in this diff and drop out when it merges.

repeat has no tests, and could not have had: rows=8, cols=512, repeat=4 does not
build.

Both taps split cols as

sizes=[repeat, rows, cols // cols_split, cols_split]   strides=[..., cols_split, 1]

so the innermost dim counts chunks and the contiguous run sits one dim out. cols_split
is 1 whenever no split is needed, which makes the innermost dim one element. At bf16
that is two bytes, not a whole 32-bit word, and verifyStridesWraps rejects it:

'aie.dma_bd' op Transfer sizes must be multiples of 4 bytes. 1 elements at 2 bytes
each equal 2 bytes, which is not divisible by 4.
aie.dma_bd(%arg0 : memref<8x512xbf16> ... sizes = [4, 8, 512, 1] strides = [0, 512, 1, 1])

The 512-element stride-1 run the transfer is actually made of is right there in dim 2.

The reason this survived: llama_npu.py passes cols = prompt_len * head_dim, far above
1023, so it lands at cols_split = 256 and its innermost dim is a healthy 256 elements.
The only caller in the tree never trips it; every small-cols shape does, which is what a
test would use.

Added

  • iron/operators/repeat/test.py. Five device arms at rel_tol=abs_tol=0 (repeat moves
    data and computes nothing) spanning cols_split 1, 2, 4 and 256 -- the last being the
    shape llama_npu.py actually dispatches -- plus three arms pinning the shapes that have
    no legal split. 8/8.

Changed

  • iron/operators/repeat/design.py: swap the two inner dims so the innermost carries
    cols // cols_split at stride 1. The address sequence is byte-identical either way --
    the nested (outer, inner) walk of a linear range is the same walk regardless of which
    factor is outer -- so the change is only in which dim the hardware sees as innermost.

    The swap moves cols_split onto the next dim out, which carries the same 10-bit wrap
    field, so bounding the chunk length alone is not sufficient. The selection loop now
    searches for a divisor satisfying all three constraints at once: chunk <= 1023, chunk a
    whole number of 32-bit words, and count <= 1023. Where no divisor satisfies them -- an
    odd cols, a prime above 1023, or twice such a prime -- it raises rather than emitting a
    tap the BD verifier rejects less legibly. Every cols that worked before selects the
    same cols_split, including llama's 131072.

Removed

Evidence

8/8 on device, run without the not extensive filter so both extensive arms -- including
the llama shape -- actually executed. The emitted BD for the llama arm is
sizes = [4, 8, 256, 512] strides = [0, 131072, 512, 1].

@atassis atassis changed the title repeat: put the chunk length innermost, and add test coverage repeat: split cols against every constraint the BD imposes, and add test coverage Aug 27, 2026
andrej
andrej approved these changes Aug 28, 2026
View reviewed changes

@andrej andrej left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, this is a good improvement, and thanks for adding testing. I added these ops in a rush to enable llama, not really testing them (obviously) for other cases, so this is a great improvement and a clean solution with figuring out the right split.

Comment thread iron/operators/repeat/design.py Outdated
atassis and others added 2 commits August 28, 2026 16:31
@atassis @andrej
repeat: split cols against every constraint the BD imposes
b6342f2 
The taps split cols as sizes [..., cols // cols_split, cols_split] with strides
[..., cols_split, 1], so the innermost dim counts chunks and the contiguous run sits
one dim out. In the unsplit case that is a 1-element innermost dim: at bf16 two bytes,
not a whole 32-bit word, and the BD verifier rejects it -- rows=8 cols=512 repeat=4
does not build at all.

Swapping the two inner dims gives a byte-identical address sequence (the nested
(outer, inner) walk of a linear range is the same walk either way) while making the
innermost dim the contiguous run.

The swap moves cols_split onto the next dim out, which carries the SAME 10-bit wrap
field, so bounding the chunk length alone is not enough -- and the old assert, which
bounded cols_split, was the only thing checking it. Rather than move the assert, the
selection loop now searches for a divisor satisfying all three constraints at once:
chunk <= 1023, chunk a whole number of 32-bit words, and count <= 1023. Where no
divisor satisfies them -- an odd cols, a prime above 1023, or 2 x such a prime -- it
raises instead of emitting a tap the verifier will reject less legibly. Every cols
that worked before selects the same cols_split, llama's 131072 included.

Adds the operator's first test coverage: five device arms at exact equality spanning
cols_split 1, 2, 4 and 256 (the llama shape), plus three rejection arms. 8/8.
@andrej
Update iron/operators/repeat/design.py
40796e4
@andrej
andrej enabled auto-merge August 28, 2026 23:01
@github-actions

github-actions Bot commented Aug 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

7e71179 (2026_08_29_03_35_07)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 396.38
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 419.84
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 355.54
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 312.80
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 398.08
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 365.28
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 502.82
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 452.62
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 542.40
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 404.14
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 442.12
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 470.58
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 435.36
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 438.60
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 421.54
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 615.64
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 322.14
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 386.92
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 351.40
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 690.46
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 451.64
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 495.76
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 686.48
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 82499.82
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 24769.78
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 4574.94
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 6256.24
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.11
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.50
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 7.15
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 9.77
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.70
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 6.52
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 9.38
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 1.59
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.40
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.39
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.64
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 419.40
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 658.06
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 708.74
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 867.66
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 400.00
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 458.76
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 341.14
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 279.10
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 311.46
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 675.10
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 355.88
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 478.80
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 792.42
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 448.12
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 364.70
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 353.56
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 379.48
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 374.44
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 438.02
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 450.98
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 413.16
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 741.76
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 354.00
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 420.54
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 654.72
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 472.16
iron/operators/repeat
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word] - - ✅ -
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None] - - ✅ 312.68
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64] - - ✅ 635.14
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None] - - ✅ 317.68
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 334.86
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 442.28
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 279.78
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 426.00
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 601.96
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 354.42
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 391.86
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 425.96
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 407.84
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 360.64
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 485.24
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 499.92
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 400.04
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 607.70
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 288.06
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 377.74
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 364.14
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 401.28
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 426.94
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 408.60
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 409.50
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 423.04
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 390.60
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 266.86
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 447.08
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 468.12
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 346.48
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 444.26
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 458.58
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 14201.79
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 14905.04
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 24813.44
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 370.78
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 418.12
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 672.88
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 448.60
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 422.46
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 535.12
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 1093.02
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 1277.80
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 686.04
Phoenix - Small

IRON

Tested on 2026_08_29_03_35_07 at commit 7e71179.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5396.380.03n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5419.840.04n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5355.540.04n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5312.800.02n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5398.080.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5365.280.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5502.820.01n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5452.620.01n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5542.400.01n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5404.140.03n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5442.120.03n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5470.580.03n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5435.360.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5438.600.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5421.540.03n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5615.640.02n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5322.140.03n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5386.920.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5351.400.03n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5690.460.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5451.640.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5495.760.4619.45
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5686.480.3615.29
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/582499.820.31208.37
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/524769.781.02693.60
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/54574.941.90498.79
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/56256.240.2010.88
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.110.11
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.503.50
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a7.157.15
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a9.779.76
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.703.70
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a6.526.52
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a9.389.37
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a1.591.59
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.400.39
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.390.38
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.641.61
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5419.400.02n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5658.060.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5708.740.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5867.660.01n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5400.000.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5458.760.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5341.140.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5279.100.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5311.460.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5675.100.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5355.880.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5478.800.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5792.420.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5448.120.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5364.700.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5353.560.03n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5379.480.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5374.440.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5438.020.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5450.980.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5413.160.02n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5741.760.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5354.000.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5420.540.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5654.720.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5472.160.02n/a
iron/operators/repeat
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]✅ 5/5n/an/an/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]✅ 5/5312.680.08n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]✅ 5/5635.140.12n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]✅ 5/5317.680.02n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5334.860.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5442.280.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5279.780.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5426.000.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5601.960.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5354.420.04n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5391.860.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5425.960.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5407.840.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5360.640.03n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5485.240.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5499.920.22n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5400.040.26n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5607.700.19n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5288.060.26n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5377.740.21n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5364.140.22n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5401.280.02n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5426.940.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5408.600.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5409.500.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5423.040.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5390.600.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5266.860.03n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5447.080.02n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5468.120.02n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5346.480.41n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/5444.260.32n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5458.580.33n/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/514201.790.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/514905.040.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/524813.440.09n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5370.780.02n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5418.120.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5672.880.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5448.600.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5422.460.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5535.120.02n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/51093.021.01n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/51277.801.70n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5686.040.99n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (-5.45%)0.03 (-9.85%)0.03 (-24.13%)0.02 (-0.75%)0.01 (-17.75%)524.00 (+0.75%)396.38 (+9.15%)395.50 (+31.79%)298.50 (+5.78%)91.87 (-12.03%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)520.10 (n/a)363.14 (n/a)300.10 (n/a)282.20 (n/a)104.44 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.07 (+38.84%)0.04 (-22.53%)0.03 (-46.99%)0.02 (-15.90%)0.02 (+85.91%)573.40 (+18.91%)419.84 (+44.26%)446.10 (+88.63%)166.60 (-27.97%)152.73 (+41.54%)
3ad2eb2 — 2026-08-29 00:27:500.05 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)482.20 (n/a)291.02 (n/a)236.50 (n/a)231.30 (n/a)107.91 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.08 (+26.03%)0.04 (+9.71%)0.04 (+8.86%)0.02 (-6.54%)0.02 (+42.74%)579.30 (+7.00%)355.54 (-0.58%)289.70 (-8.12%)163.30 (-20.65%)179.85 (+24.75%)
3ad2eb2 — 2026-08-29 00:27:500.06 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.02 (n/a)541.40 (n/a)357.62 (n/a)315.30 (n/a)205.80 (n/a)144.16 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (-21.43%)0.02 (+24.02%)0.02 (+55.90%)0.01 (+8.21%)0.00 (-39.47%)506.70 (-7.60%)312.80 (-24.52%)273.60 (-35.86%)243.80 (+27.24%)109.38 (-19.02%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)548.40 (n/a)414.42 (n/a)426.60 (n/a)191.60 (n/a)135.07 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (-11.57%)0.02 (-2.62%)0.02 (+65.24%)0.01 (-11.22%)0.01 (-18.45%)604.10 (+12.62%)398.08 (+1.41%)288.30 (-39.47%)257.20 (+13.10%)166.17 (+11.21%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)536.40 (n/a)392.56 (n/a)476.30 (n/a)227.40 (n/a)149.43 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (-20.12%)0.02 (-0.68%)0.02 (+44.58%)0.01 (+3.25%)0.00 (-35.04%)488.70 (-3.15%)365.28 (-4.41%)297.60 (-30.82%)283.10 (+25.15%)101.32 (-21.86%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)504.60 (n/a)382.14 (n/a)430.20 (n/a)226.20 (n/a)129.66 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (-5.99%)0.01 (-32.76%)0.01 (-37.24%)0.01 (-56.27%)0.01 (+69.96%)836.20 (+128.66%)502.82 (+69.62%)480.80 (+59.36%)238.50 (+6.38%)214.30 (+303.81%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)365.70 (n/a)296.44 (n/a)301.70 (n/a)224.20 (n/a)53.07 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (-12.43%)0.01 (+0.87%)0.01 (+11.21%)0.01 (+246.07%)0.00 (-49.22%)535.90 (-71.11%)452.62 (-35.53%)478.90 (-10.08%)277.90 (+14.22%)103.17 (-84.38%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)1854.70 (n/a)702.10 (n/a)532.60 (n/a)243.30 (n/a)660.50 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.01 (-13.63%)0.01 (-5.15%)0.01 (-9.70%)0.01 (+30.34%)0.00 (-49.75%)668.20 (-23.28%)542.40 (-1.90%)542.30 (+10.74%)432.40 (+15.77%)90.77 (-55.27%)
3ad2eb2 — 2026-08-29 00:27:500.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)871.00 (n/a)552.90 (n/a)489.70 (n/a)373.50 (n/a)202.95 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)532.40 (n/a)404.14 (n/a)428.30 (n/a)291.00 (n/a)94.91 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.06 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)551.10 (n/a)442.12 (n/a)467.90 (n/a)211.70 (n/a)136.20 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)635.70 (n/a)470.58 (n/a)480.80 (n/a)273.90 (n/a)130.88 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)763.90 (n/a)435.36 (n/a)297.10 (n/a)270.90 (n/a)219.59 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)493.10 (n/a)438.60 (n/a)434.20 (n/a)402.20 (n/a)34.78 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)496.70 (n/a)421.54 (n/a)436.40 (n/a)306.10 (n/a)70.23 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1848.30 (n/a)615.64 (n/a)338.80 (n/a)236.40 (n/a)692.66 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)432.50 (n/a)322.14 (n/a)297.70 (n/a)248.10 (n/a)80.84 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)530.90 (n/a)386.92 (n/a)424.70 (n/a)237.20 (n/a)137.11 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)604.30 (n/a)351.40 (n/a)288.20 (n/a)258.70 (n/a)145.26 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1905.30 (n/a)690.46 (n/a)430.70 (n/a)253.10 (n/a)693.76 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)576.50 (n/a)451.64 (n/a)433.10 (n/a)376.40 (n/a)74.33 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.56 (-19.76%)0.46 (+0.35%)0.45 (+20.98%)0.36 (+5.72%)0.07 (-51.36%)617.70 (-5.41%)495.76 (-5.55%)493.20 (-17.33%)396.30 (+24.62%)81.95 (-43.10%)23.81 (-19.76%)19.45 (+0.35%)19.14 (+20.98%)15.28 (+5.72%)3.15 (-51.36%)
3ad2eb2 — 2026-08-29 00:27:500.70 (n/a)0.45 (n/a)0.37 (n/a)0.34 (n/a)0.15 (n/a)653.00 (n/a)524.90 (n/a)596.60 (n/a)318.00 (n/a)144.04 (n/a)29.68 (n/a)19.38 (n/a)15.82 (n/a)14.45 (n/a)6.47 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.49 (+10.42%)0.36 (+19.84%)0.35 (+0.85%)0.19 (+99.38%)0.11 (-15.62%)1187.50 (-49.85%)686.48 (-31.15%)627.50 (-0.84%)454.40 (-9.45%)289.60 (-62.72%)20.77 (+10.42%)15.29 (+19.84%)15.04 (+0.85%)7.95 (+99.38%)4.75 (-15.62%)
3ad2eb2 — 2026-08-29 00:27:500.44 (n/a)0.30 (n/a)0.35 (n/a)0.09 (n/a)0.13 (n/a)2367.70 (n/a)997.10 (n/a)632.80 (n/a)501.80 (n/a)776.90 (n/a)18.81 (n/a)12.76 (n/a)14.91 (n/a)3.99 (n/a)5.63 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.31 (-0.23%)0.31 (+0.71%)0.31 (+0.79%)0.29 (+0.58%)0.01 (-2.46%)86353.10 (-0.58%)82499.82 (-0.71%)81858.90 (-0.78%)80639.80 (+0.23%)2312.91 (-3.01%)213.04 (-0.23%)208.37 (+0.71%)209.87 (+0.79%)198.95 (+0.58%)5.70 (-2.46%)
3ad2eb2 — 2026-08-29 00:27:500.31 (n/a)0.30 (n/a)0.31 (n/a)0.29 (n/a)0.01 (n/a)86854.60 (n/a)83088.32 (n/a)82506.20 (n/a)80455.40 (n/a)2384.65 (n/a)213.53 (n/a)206.90 (n/a)208.23 (n/a)197.80 (n/a)5.84 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:411.02 (+0.01%)1.02 (+3.07%)1.02 (+0.77%)1.01 (+8.55%)0.01 (-87.44%)24904.20 (-7.87%)24769.78 (-3.11%)24763.90 (-0.76%)24640.60 (-0.01%)123.60 (-88.41%)697.22 (+0.01%)693.60 (+3.07%)693.75 (+0.77%)689.84 (+8.55%)3.46 (-87.44%)
3ad2eb2 — 2026-08-29 00:27:501.02 (n/a)0.99 (n/a)1.01 (n/a)0.93 (n/a)0.04 (n/a)27032.40 (n/a)25565.84 (n/a)24953.90 (n/a)24643.50 (n/a)1066.75 (n/a)697.14 (n/a)672.90 (n/a)688.46 (n/a)635.53 (n/a)27.55 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:412.89 (-14.31%)1.90 (-28.96%)1.83 (-33.93%)1.34 (-29.18%)0.62 (-7.11%)6021.40 (+41.21%)4574.94 (+43.97%)4409.00 (+51.36%)2793.40 (+16.70%)1321.60 (+57.12%)756.77 (-14.31%)498.79 (-28.96%)479.46 (-33.93%)351.07 (-29.18%)163.34 (-7.11%)
3ad2eb2 — 2026-08-29 00:27:503.37 (n/a)2.68 (n/a)2.77 (n/a)1.89 (n/a)0.67 (n/a)4264.20 (n/a)3177.78 (n/a)2913.00 (n/a)2393.70 (n/a)841.13 (n/a)883.10 (n/a)702.16 (n/a)725.70 (n/a)495.74 (n/a)175.84 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.24 (+24.64%)0.20 (+13.06%)0.20 (+10.09%)0.17 (+16.47%)0.03 (+47.12%)7316.80 (-14.14%)6256.24 (-11.14%)6110.50 (-9.17%)5202.50 (-19.77%)842.49 (+0.24%)12.90 (+24.64%)10.88 (+13.06%)10.98 (+10.09%)9.17 (+16.47%)1.48 (+47.12%)
3ad2eb2 — 2026-08-29 00:27:500.19 (n/a)0.18 (n/a)0.19 (n/a)0.15 (n/a)0.02 (n/a)8521.70 (n/a)7040.34 (n/a)6727.30 (n/a)6484.40 (n/a)840.47 (n/a)10.35 (n/a)9.63 (n/a)9.98 (n/a)7.88 (n/a)1.00 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.13 (n/a)0.11 (n/a)0.11 (n/a)0.09 (n/a)0.02 (n/a)0.13 (n/a)0.11 (n/a)0.11 (n/a)0.09 (n/a)0.02 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:413.67 (n/a)3.50 (n/a)3.55 (n/a)3.36 (n/a)0.14 (n/a)3.67 (n/a)3.50 (n/a)3.54 (n/a)3.36 (n/a)0.14 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:417.52 (+1.51%)7.15 (+2.30%)7.00 (-2.06%)6.82 (+9.85%)0.31 (-36.66%)7.52 (+1.51%)7.15 (+2.30%)7.00 (-2.06%)6.82 (+9.85%)0.31 (-36.66%)
3ad2eb2 — 2026-08-29 00:27:507.41 (n/a)6.99 (n/a)7.15 (n/a)6.21 (n/a)0.49 (n/a)7.41 (n/a)6.99 (n/a)7.14 (n/a)6.21 (n/a)0.49 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:4113.90 (+5.71%)9.77 (+2.41%)8.62 (-1.42%)8.24 (+12.16%)2.39 (+7.89%)13.89 (+5.71%)9.76 (+2.41%)8.62 (-1.42%)8.23 (+12.16%)2.39 (+7.89%)
3ad2eb2 — 2026-08-29 00:27:5013.15 (n/a)9.54 (n/a)8.75 (n/a)7.34 (n/a)2.21 (n/a)13.14 (n/a)9.53 (n/a)8.74 (n/a)7.34 (n/a)2.21 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:413.82 (n/a)3.70 (n/a)3.73 (n/a)3.45 (n/a)0.15 (n/a)3.82 (n/a)3.70 (n/a)3.73 (n/a)3.45 (n/a)0.15 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:417.43 (+3.77%)6.52 (+8.83%)6.87 (+19.27%)5.46 (+1.51%)0.87 (+25.71%)7.42 (+3.77%)6.52 (+8.83%)6.86 (+19.27%)5.45 (+1.51%)0.87 (+25.71%)
3ad2eb2 — 2026-08-29 00:27:507.16 (n/a)5.99 (n/a)5.76 (n/a)5.37 (n/a)0.69 (n/a)7.15 (n/a)5.99 (n/a)5.75 (n/a)5.37 (n/a)0.69 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:4113.92 (+42.03%)9.38 (+10.91%)8.40 (+3.32%)7.62 (-1.50%)2.57 (+218.87%)13.91 (+42.03%)9.37 (+10.91%)8.39 (+3.32%)7.61 (-1.50%)2.56 (+218.87%)
3ad2eb2 — 2026-08-29 00:27:509.80 (n/a)8.46 (n/a)8.13 (n/a)7.73 (n/a)0.80 (n/a)9.80 (n/a)8.45 (n/a)8.12 (n/a)7.73 (n/a)0.80 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:413.03 (-0.69%)1.59 (-16.33%)1.25 (-37.04%)1.04 (-11.53%)0.83 (+6.78%)3.03 (-0.69%)1.59 (-16.33%)1.25 (-37.04%)1.04 (-11.53%)0.83 (+6.78%)
3ad2eb2 — 2026-08-29 00:27:503.05 (n/a)1.90 (n/a)1.99 (n/a)1.17 (n/a)0.78 (n/a)3.05 (n/a)1.90 (n/a)1.98 (n/a)1.17 (n/a)0.78 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.58 (-9.88%)0.40 (+4.72%)0.50 (+41.91%)0.07 (+1.65%)0.20 (-5.33%)0.57 (-9.88%)0.39 (+4.72%)0.49 (+41.91%)0.07 (+1.65%)0.20 (-5.33%)
3ad2eb2 — 2026-08-29 00:27:500.64 (n/a)0.38 (n/a)0.35 (n/a)0.07 (n/a)0.21 (n/a)0.63 (n/a)0.37 (n/a)0.34 (n/a)0.07 (n/a)0.21 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:410.72 (+37.08%)0.39 (-2.10%)0.40 (-16.58%)0.08 (-7.24%)0.31 (+72.69%)0.71 (+37.08%)0.38 (-2.10%)0.39 (-16.58%)0.07 (-7.24%)0.31 (+72.69%)
3ad2eb2 — 2026-08-29 00:27:500.52 (n/a)0.40 (n/a)0.47 (n/a)0.08 (n/a)0.18 (n/a)0.52 (n/a)0.39 (n/a)0.47 (n/a)0.08 (n/a)0.18 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
7e71179 — 2026-08-29 03:30:412.65 (-1.11%)1.64 (+1.32%)1.64 (-14.19%)0.64 (+43.26%)0.98 (-11.77%)2.61 (-1.11%)1.61 (+1.32%)1.61 (-14.19%)0.63 (+43.26%)0.96 (-11.77%)
3ad2eb2 — 2026-08-29 00:27:502.68 (n/a)1.62 (n/a)1.91 (n/a)0.45 (n/a)1.11 (n/a)2.64 (n/a)1.59 (n/a)1.88 (n/a)0.44 (n/a)1.09 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)628.10 (n/a)419.40 (n/a)445.60 (n/a)271.80 (n/a)151.07 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.03 (n/a)0.00 (n/a)0.01 (n/a)1942.50 (n/a)658.06 (n/a)294.70 (n/a)237.00 (n/a)730.80 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1935.30 (n/a)708.74 (n/a)465.20 (n/a)267.50 (n/a)697.94 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.00 (n/a)1937.20 (n/a)867.66 (n/a)623.70 (n/a)485.60 (n/a)605.80 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)535.20 (n/a)400.00 (n/a)383.30 (n/a)231.40 (n/a)125.82 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)639.70 (n/a)458.76 (n/a)460.00 (n/a)299.00 (n/a)144.47 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+9.43%)0.03 (+18.36%)0.03 (+26.17%)0.01 (-27.58%)0.01 (+37.13%)719.30 (+38.09%)341.14 (-6.10%)243.50 (-20.76%)240.70 (-8.62%)211.53 (+79.04%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)520.90 (n/a)363.30 (n/a)307.30 (n/a)263.40 (n/a)118.15 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (+35.68%)0.03 (+28.06%)0.03 (+14.57%)0.02 (+34.96%)0.01 (+12.60%)380.20 (-25.90%)279.10 (-23.34%)273.70 (-12.70%)202.20 (-26.29%)66.61 (-37.18%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)513.10 (n/a)364.06 (n/a)313.50 (n/a)274.30 (n/a)106.03 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (+15.18%)0.03 (+27.08%)0.03 (+49.24%)0.02 (+30.61%)0.01 (+7.27%)416.80 (-23.44%)311.46 (-22.73%)297.60 (-32.99%)198.70 (-13.19%)95.84 (-25.13%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)544.40 (n/a)403.10 (n/a)444.10 (n/a)228.90 (n/a)128.02 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-6.95%)0.02 (-3.35%)0.03 (+57.22%)0.00 (-67.32%)0.01 (+36.80%)1873.00 (+206.00%)675.10 (+58.31%)297.30 (-36.39%)260.50 (+7.47%)689.85 (+347.81%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)612.10 (n/a)426.44 (n/a)467.40 (n/a)242.40 (n/a)154.05 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (+31.18%)0.03 (+40.01%)0.03 (+63.76%)0.02 (+17.11%)0.01 (+62.95%)490.70 (-14.60%)355.88 (-25.27%)309.30 (-38.93%)229.60 (-23.77%)123.44 (+19.88%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)574.60 (n/a)476.20 (n/a)506.50 (n/a)301.20 (n/a)102.97 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+89.81%)0.02 (+32.42%)0.02 (-2.36%)0.01 (+70.69%)0.01 (+118.14%)590.90 (-41.41%)478.80 (-22.57%)539.70 (+2.41%)249.90 (-47.32%)138.07 (-37.71%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.01 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)1008.60 (n/a)618.36 (n/a)527.00 (n/a)474.40 (n/a)221.65 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+0.17%)0.02 (-5.73%)0.02 (+18.48%)0.00 (-74.02%)0.01 (+37.13%)2458.80 (+284.91%)792.42 (+77.35%)361.80 (-15.61%)265.90 (-0.15%)937.73 (+471.14%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)638.80 (n/a)446.80 (n/a)428.70 (n/a)266.30 (n/a)164.18 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-4.12%)0.02 (+9.56%)0.02 (+3.57%)0.01 (+0.89%)0.01 (+6.24%)644.10 (-0.88%)448.12 (-7.14%)464.40 (-3.45%)282.30 (+4.29%)155.07 (+12.24%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)649.80 (n/a)482.60 (n/a)481.00 (n/a)270.70 (n/a)138.17 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (+13.91%)0.02 (-0.63%)0.02 (-3.83%)0.01 (-5.52%)0.01 (+30.59%)567.60 (+5.86%)364.70 (+4.43%)328.70 (+3.99%)227.10 (-12.21%)136.87 (+21.34%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)536.20 (n/a)349.22 (n/a)316.10 (n/a)258.70 (n/a)112.80 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-32.23%)0.03 (-14.81%)0.03 (-7.50%)0.01 (-2.18%)0.01 (-38.48%)566.60 (+2.22%)353.56 (+11.25%)287.90 (+8.11%)270.40 (+47.52%)125.04 (-11.55%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)554.30 (n/a)317.80 (n/a)266.30 (n/a)183.30 (n/a)141.37 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (-12.88%)0.02 (-15.25%)0.02 (-40.24%)0.02 (+2.71%)0.01 (-10.48%)526.30 (-2.65%)379.48 (+15.98%)411.30 (+67.33%)223.30 (+14.75%)140.66 (-3.94%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)540.60 (n/a)327.20 (n/a)245.80 (n/a)194.60 (n/a)146.43 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+29.81%)0.02 (+37.37%)0.03 (+52.50%)0.01 (-2.95%)0.01 (+59.55%)647.60 (+3.04%)374.44 (-22.82%)302.20 (-34.42%)244.00 (-22.96%)167.48 (+19.45%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)628.50 (n/a)485.16 (n/a)460.80 (n/a)316.70 (n/a)140.21 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+63.35%)0.02 (+45.69%)0.03 (+88.48%)0.01 (-25.50%)0.01 (+292.42%)789.60 (+34.22%)438.02 (-13.11%)275.20 (-46.93%)234.40 (-38.77%)260.72 (+217.19%)
3ad2eb2 — 2026-08-29 00:27:500.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)588.30 (n/a)504.12 (n/a)518.60 (n/a)382.80 (n/a)82.20 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+21.46%)0.02 (+3.21%)0.02 (+7.59%)0.01 (-11.62%)0.01 (+46.60%)611.80 (+13.15%)450.98 (+0.81%)467.40 (-7.06%)245.40 (-17.68%)132.36 (+25.26%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)540.70 (n/a)447.36 (n/a)502.90 (n/a)298.10 (n/a)105.67 (n/a)
iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)427.30 (n/a)312.68 (n/a)298.50 (n/a)240.40 (n/a)70.91 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.17 (n/a)0.12 (n/a)0.14 (n/a)0.02 (n/a)0.06 (n/a)1926.60 (n/a)635.14 (n/a)285.30 (n/a)240.80 (n/a)728.61 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)500.40 (n/a)317.68 (n/a)270.00 (n/a)264.20 (n/a)102.48 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-6.96%)0.03 (-6.75%)0.02 (-25.40%)0.02 (+35.81%)0.01 (-43.56%)423.80 (-26.37%)334.86 (-2.91%)348.20 (+34.08%)241.80 (+7.51%)68.97 (-54.93%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)575.60 (n/a)344.88 (n/a)259.70 (n/a)224.90 (n/a)153.04 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (-21.98%)0.03 (-23.41%)0.02 (-37.65%)0.02 (-5.00%)0.01 (-15.73%)556.80 (+5.26%)442.28 (+29.68%)495.50 (+60.41%)318.60 (+28.21%)114.71 (+4.04%)
3ad2eb2 — 2026-08-29 00:27:500.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)529.00 (n/a)341.06 (n/a)308.90 (n/a)248.50 (n/a)110.26 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (+0.77%)0.03 (+6.22%)0.03 (+9.19%)0.02 (+35.16%)0.00 (-35.64%)341.90 (-26.01%)279.78 (-9.07%)259.10 (-8.41%)245.40 (-0.73%)39.65 (-54.75%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)462.10 (n/a)307.70 (n/a)282.90 (n/a)247.20 (n/a)87.64 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.04 (-5.29%)0.03 (-6.99%)0.02 (-20.00%)0.02 (-7.11%)0.01 (-8.98%)603.10 (+7.66%)426.00 (+6.28%)451.00 (+25.00%)282.70 (+5.60%)136.99 (-3.06%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)560.20 (n/a)400.82 (n/a)360.80 (n/a)267.70 (n/a)141.31 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-8.10%)0.02 (-14.98%)0.03 (+1.82%)0.00 (-79.33%)0.01 (+136.13%)1902.90 (+383.95%)601.96 (+106.76%)274.30 (-1.79%)268.10 (+8.81%)727.34 (+1135.97%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)393.20 (n/a)291.14 (n/a)279.30 (n/a)246.40 (n/a)58.85 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.06 (+19.72%)0.04 (-8.92%)0.04 (-16.19%)0.02 (-7.54%)0.02 (+43.71%)590.50 (+8.17%)354.42 (+18.86%)288.10 (+19.30%)177.90 (-16.48%)175.48 (+25.80%)
3ad2eb2 — 2026-08-29 00:27:500.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)545.90 (n/a)298.18 (n/a)241.50 (n/a)213.00 (n/a)139.49 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-4.11%)0.02 (-9.53%)0.03 (-0.14%)0.01 (+12.49%)0.01 (+4.25%)620.40 (-11.10%)391.86 (+9.72%)287.40 (+0.14%)243.30 (+4.29%)172.56 (-10.15%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)697.90 (n/a)357.14 (n/a)287.00 (n/a)233.30 (n/a)192.05 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-0.46%)0.02 (-7.19%)0.02 (-26.95%)0.02 (+43.77%)0.01 (-33.16%)565.90 (-30.44%)425.96 (-3.04%)410.40 (+36.89%)293.30 (+0.48%)113.25 (-50.10%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)813.60 (n/a)439.30 (n/a)299.80 (n/a)291.90 (n/a)226.93 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-13.64%)0.02 (+8.26%)0.02 (+18.65%)0.01 (+9.63%)0.01 (-29.45%)572.10 (-8.79%)407.84 (-13.74%)445.10 (-15.70%)240.70 (+15.78%)125.95 (-22.89%)
3ad2eb2 — 2026-08-29 00:27:500.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)627.20 (n/a)472.80 (n/a)528.00 (n/a)207.90 (n/a)163.34 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.06 (+68.59%)0.03 (+23.86%)0.03 (+13.64%)0.01 (-19.42%)0.02 (+137.49%)657.70 (+24.09%)360.64 (-3.27%)285.70 (-12.01%)160.90 (-40.67%)202.97 (+79.63%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)530.00 (n/a)372.84 (n/a)324.70 (n/a)271.20 (n/a)112.99 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.03 (-10.35%)0.02 (-9.64%)0.02 (-4.29%)0.01 (+10.71%)0.01 (-29.57%)617.20 (-9.67%)485.24 (+5.15%)499.70 (+4.47%)317.40 (+11.52%)129.40 (-23.66%)
3ad2eb2 — 2026-08-29 00:27:500.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)683.30 (n/a)461.46 (n/a)478.30 (n/a)284.60 (n/a)169.50 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.35 (+2.81%)0.22 (-2.30%)0.21 (+9.52%)0.12 (-23.74%)0.08 (+10.68%)814.10 (+31.14%)499.92 (+6.20%)459.20 (-8.69%)282.10 (-2.72%)195.42 (+43.51%)
3ad2eb2 — 2026-08-29 00:27:500.34 (n/a)0.23 (n/a)0.20 (n/a)0.16 (n/a)0.07 (n/a)620.80 (n/a)470.72 (n/a)502.90 (n/a)290.00 (n/a)136.18 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.41 (+10.44%)0.26 (-1.04%)0.24 (-20.26%)0.18 (+21.90%)0.09 (-6.26%)537.60 (-17.96%)400.04 (-3.26%)410.90 (+25.43%)240.30 (-9.46%)105.76 (-35.39%)
3ad2eb2 — 2026-08-29 00:27:500.37 (n/a)0.27 (n/a)0.30 (n/a)0.15 (n/a)0.09 (n/a)655.30 (n/a)413.52 (n/a)327.60 (n/a)265.40 (n/a)163.67 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.36 (+23.61%)0.19 (-6.70%)0.17 (-14.73%)0.10 (-39.76%)0.10 (+105.38%)972.00 (+66.01%)607.70 (+23.71%)588.40 (+17.28%)276.50 (-19.10%)264.85 (+170.70%)
3ad2eb2 — 2026-08-29 00:27:500.29 (n/a)0.21 (n/a)0.20 (n/a)0.17 (n/a)0.05 (n/a)585.50 (n/a)491.24 (n/a)501.70 (n/a)341.80 (n/a)97.84 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.29 (+11.41%)0.26 (+48.00%)0.26 (+71.68%)0.23 (+65.97%)0.02 (-58.21%)318.00 (-39.74%)288.06 (-35.48%)283.30 (-41.76%)256.50 (-10.25%)22.74 (-77.16%)
3ad2eb2 — 2026-08-29 00:27:500.26 (n/a)0.17 (n/a)0.15 (n/a)0.14 (n/a)0.05 (n/a)527.70 (n/a)446.48 (n/a)486.40 (n/a)285.80 (n/a)99.55 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.31 (+4.61%)0.21 (-13.27%)0.17 (-32.20%)0.16 (+7.03%)0.07 (+19.09%)471.70 (-6.58%)377.74 (+17.25%)438.10 (+47.51%)241.00 (-4.40%)110.87 (+5.89%)
3ad2eb2 — 2026-08-29 00:27:500.29 (n/a)0.24 (n/a)0.25 (n/a)0.15 (n/a)0.06 (n/a)504.90 (n/a)322.16 (n/a)297.00 (n/a)252.10 (n/a)104.70 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.32 (+5.07%)0.22 (+22.25%)0.20 (+36.52%)0.15 (+56.11%)0.08 (-11.37%)495.70 (-35.95%)364.14 (-24.84%)363.40 (-26.76%)231.40 (-4.81%)121.76 (-44.07%)
3ad2eb2 — 2026-08-29 00:27:500.30 (n/a)0.18 (n/a)0.15 (n/a)0.10 (n/a)0.09 (n/a)773.90 (n/a)484.46 (n/a)496.20 (n/a)243.10 (n/a)217.71 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.48 (+28.60%)0.41 (+57.68%)0.46 (+85.44%)0.22 (+9.52%)0.11 (+65.25%)585.60 (-8.70%)346.48 (-33.77%)287.50 (-46.07%)273.80 (-22.24%)134.38 (+26.79%)
3ad2eb2 — 2026-08-29 00:27:500.37 (n/a)0.26 (n/a)0.25 (n/a)0.20 (n/a)0.06 (n/a)641.40 (n/a)523.18 (n/a)533.10 (n/a)352.10 (n/a)105.98 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.45 (+5.11%)0.32 (+23.21%)0.27 (+21.26%)0.23 (+36.46%)0.10 (-7.33%)579.30 (-26.72%)444.26 (-23.02%)487.00 (-17.54%)292.80 (-4.87%)130.59 (-38.87%)
3ad2eb2 — 2026-08-29 00:27:500.43 (n/a)0.26 (n/a)0.22 (n/a)0.17 (n/a)0.11 (n/a)790.50 (n/a)577.08 (n/a)590.60 (n/a)307.80 (n/a)213.62 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.53 (+23.42%)0.33 (+12.78%)0.28 (-30.18%)0.19 (+168.48%)0.14 (-15.36%)685.20 (-62.75%)458.58 (-36.83%)475.10 (+43.23%)249.10 (-18.97%)176.27 (-73.24%)
3ad2eb2 — 2026-08-29 00:27:500.43 (n/a)0.29 (n/a)0.40 (n/a)0.07 (n/a)0.16 (n/a)1839.60 (n/a)725.98 (n/a)331.70 (n/a)307.40 (n/a)658.64 (n/a)
iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.00 (+0.00%)0.00 (-5.26%)0.00 (-33.33%)0.00 (+0.00%)0.00 (+6.90%)20754.58 (-8.36%)14201.79 (+2.29%)17439.76 (+12.10%)6936.98 (+6.61%)6685.59 (-2.41%)
3ad2eb2 — 2026-08-29 00:27:500.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)22648.63 (n/a)13884.09 (n/a)15557.60 (n/a)6506.70 (n/a)6850.41 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.00 (+0.00%)0.00 (-19.05%)0.00 (-63.64%)0.00 (+0.00%)0.00 (+7.17%)21164.06 (-5.33%)14905.04 (+19.66%)19017.94 (+149.91%)7504.41 (+1.08%)6788.84 (-3.19%)
3ad2eb2 — 2026-08-29 00:27:500.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)22356.06 (n/a)12456.27 (n/a)7609.99 (n/a)7424.25 (n/a)7012.19 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:410.14 (-8.75%)0.09 (-27.84%)0.08 (-37.88%)0.07 (+2.49%)0.03 (-12.97%)29933.92 (-2.39%)24813.44 (+35.63%)25583.10 (+61.09%)15007.83 (+9.58%)5831.30 (-16.49%)
3ad2eb2 — 2026-08-29 00:27:500.15 (n/a)0.12 (n/a)0.13 (n/a)0.07 (n/a)0.03 (n/a)30665.29 (n/a)18295.30 (n/a)15881.58 (n/a)13695.18 (n/a)6982.78 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:411.69 (-1.09%)1.01 (-7.57%)1.31 (+30.40%)0.16 (-78.31%)0.65 (+74.92%)3338.90 (+361.11%)1093.02 (+110.53%)398.90 (-23.30%)310.80 (+1.11%)1289.42 (+756.17%)
3ad2eb2 — 2026-08-29 00:27:501.71 (n/a)1.09 (n/a)1.01 (n/a)0.72 (n/a)0.37 (n/a)724.10 (n/a)519.18 (n/a)520.10 (n/a)307.40 (n/a)150.60 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:412.61 (+9.81%)1.70 (+25.52%)2.45 (+78.85%)0.31 (+5.20%)1.15 (+47.76%)3331.30 (-4.94%)1277.80 (+0.35%)428.70 (-44.09%)401.90 (-8.93%)1298.99 (+2.51%)
3ad2eb2 — 2026-08-29 00:27:502.38 (n/a)1.36 (n/a)1.37 (n/a)0.30 (n/a)0.78 (n/a)3504.30 (n/a)1273.28 (n/a)766.80 (n/a)441.30 (n/a)1267.21 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
7e71179 — 2026-08-29 03:30:411.59 (-19.94%)0.99 (-19.96%)0.75 (-25.96%)0.43 (-43.25%)0.55 (+11.64%)1212.40 (+76.22%)686.04 (+44.56%)702.80 (+35.05%)329.80 (+24.92%)372.85 (+123.69%)
3ad2eb2 — 2026-08-29 00:27:501.99 (n/a)1.24 (n/a)1.01 (n/a)0.76 (n/a)0.49 (n/a)688.00 (n/a)474.58 (n/a)520.40 (n/a)264.00 (n/a)166.68 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_08_29_03_36_59 at commit 7e71179.

Trends:

IRON Trends

@andrej
andrej added this pull request to the merge queue Aug 29, 2026
Merged via the queue into amd:devel with commit d9e4ec5 Aug 29, 2026
5 checks passed
@atassis
atassis deleted the pr/repeat-tests branch August 29, 2026 21:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andrej andrej andrej approved these changes
@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner
@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@atassis @andrej