zephyr: fix NUCLEO benchmark timing and TCM layout#1796
Conversation
Use Zephyr's 64-bit cycle counter so long benchmark windows do not wrap, and make benchmark percentile sorting robust for large uint64_t values. Link NUCLEO-N657X0-Q Zephyr images as XIP from ITCM with runtime data and stacks in DTCM. Force the STM32N6 VTOR setup to the ITCM vector table and scrub the expanded DTCM window in the early reset hook. Keep project CFLAGS out of Zephyr's cached global CMake flags, and print the Zephyr build log when a suppressed Ninja build fails. Tested: - nix develop .#zephyr --command make run_func EXTRA_MAKEFILE=test/zephyr/platform.mk ZEPHYR_TARGET=mps3-an547 CYCLES=NO -j1 - nix develop .#zephyr --command make run_bench EXTRA_MAKEFILE=test/zephyr/platform.mk ZEPHYR_TARGET=nucleo-n657x0-q CYCLES=NO -j1 Signed-off-by: Brendan Moran <brendan.moran@arm.com>
oqs-bot
left a comment
There was a problem hiding this comment.
Mac Mini (M1, 2020) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
12318 cycles |
12317 cycles |
1.00 |
ML-KEM-512 encaps |
14763 cycles |
14761 cycles |
1.00 |
ML-KEM-512 decaps |
19318 cycles |
19315 cycles |
1.00 |
ML-KEM-768 keypair |
21263 cycles |
21263 cycles |
1 |
ML-KEM-768 encaps |
23510 cycles |
23508 cycles |
1.00 |
ML-KEM-768 decaps |
30054 cycles |
30054 cycles |
1 |
ML-KEM-1024 keypair |
30316 cycles |
30315 cycles |
1.00 |
ML-KEM-1024 encaps |
34082 cycles |
34080 cycles |
1.00 |
ML-KEM-1024 decaps |
43696 cycles |
43695 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
ppc64le (POWER10) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
38585 cycles |
37977 cycles |
1.02 |
ML-KEM-512 encaps |
43426 cycles |
43448 cycles |
1.00 |
ML-KEM-512 decaps |
54121 cycles |
53423 cycles |
1.01 |
ML-KEM-768 keypair |
67931 cycles |
67467 cycles |
1.01 |
ML-KEM-768 encaps |
76428 cycles |
76412 cycles |
1.00 |
ML-KEM-768 decaps |
91027 cycles |
90618 cycles |
1.00 |
ML-KEM-1024 keypair |
113397 cycles |
108562 cycles |
1.04 |
ML-KEM-1024 encaps |
124126 cycles |
118622 cycles |
1.05 |
ML-KEM-1024 decaps |
142680 cycles |
137281 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'ppc64le (POWER10) benchmarks'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-1024 keypair |
113397 cycles |
108562 cycles |
1.04 |
ML-KEM-1024 encaps |
124126 cycles |
118622 cycles |
1.05 |
ML-KEM-1024 decaps |
142680 cycles |
137281 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
28219 cycles |
28242 cycles |
1.00 |
ML-KEM-512 encaps |
34064 cycles |
34125 cycles |
1.00 |
ML-KEM-512 decaps |
44497 cycles |
44473 cycles |
1.00 |
ML-KEM-768 keypair |
47586 cycles |
47611 cycles |
1.00 |
ML-KEM-768 encaps |
53885 cycles |
53862 cycles |
1.00 |
ML-KEM-768 decaps |
68533 cycles |
68521 cycles |
1.00 |
ML-KEM-1024 keypair |
70182 cycles |
70247 cycles |
1.00 |
ML-KEM-1024 encaps |
78707 cycles |
78704 cycles |
1.00 |
ML-KEM-1024 decaps |
98255 cycles |
98273 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 4th gen (c7i)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
11928 cycles |
11784 cycles |
1.01 |
ML-KEM-512 encaps |
13210 cycles |
13079 cycles |
1.01 |
ML-KEM-512 decaps |
17055 cycles |
17091 cycles |
1.00 |
ML-KEM-768 keypair |
19451 cycles |
19364 cycles |
1.00 |
ML-KEM-768 encaps |
20773 cycles |
20596 cycles |
1.01 |
ML-KEM-768 decaps |
26372 cycles |
26281 cycles |
1.00 |
ML-KEM-1024 keypair |
28083 cycles |
28109 cycles |
1.00 |
ML-KEM-1024 encaps |
30214 cycles |
30378 cycles |
0.99 |
ML-KEM-1024 decaps |
37460 cycles |
37448 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 3rd gen (c6i)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
17952 cycles |
17868 cycles |
1.00 |
ML-KEM-512 encaps |
20159 cycles |
20057 cycles |
1.01 |
ML-KEM-512 decaps |
26750 cycles |
26606 cycles |
1.01 |
ML-KEM-768 keypair |
30092 cycles |
29950 cycles |
1.00 |
ML-KEM-768 encaps |
34094 cycles |
31996 cycles |
1.07 |
ML-KEM-768 decaps |
41525 cycles |
41491 cycles |
1.00 |
ML-KEM-1024 keypair |
42133 cycles |
42078 cycles |
1.00 |
ML-KEM-1024 encaps |
44892 cycles |
45040 cycles |
1.00 |
ML-KEM-1024 decaps |
58032 cycles |
57971 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-768 encaps |
34094 cycles |
31996 cycles |
1.07 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 4th gen (c7a)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
12869 cycles |
12801 cycles |
1.01 |
ML-KEM-512 encaps |
14250 cycles |
14237 cycles |
1.00 |
ML-KEM-512 decaps |
18993 cycles |
18975 cycles |
1.00 |
ML-KEM-768 keypair |
21539 cycles |
21566 cycles |
1.00 |
ML-KEM-768 encaps |
22722 cycles |
22732 cycles |
1.00 |
ML-KEM-768 decaps |
29783 cycles |
29717 cycles |
1.00 |
ML-KEM-1024 keypair |
30651 cycles |
30514 cycles |
1.00 |
ML-KEM-1024 encaps |
32698 cycles |
32678 cycles |
1.00 |
ML-KEM-1024 decaps |
41861 cycles |
41973 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton5
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
13431 cycles |
13452 cycles |
1.00 |
ML-KEM-512 encaps |
15773 cycles |
15781 cycles |
1.00 |
ML-KEM-512 decaps |
21298 cycles |
21312 cycles |
1.00 |
ML-KEM-768 keypair |
22870 cycles |
22907 cycles |
1.00 |
ML-KEM-768 encaps |
25294 cycles |
25225 cycles |
1.00 |
ML-KEM-768 decaps |
33170 cycles |
33173 cycles |
1.00 |
ML-KEM-1024 keypair |
33297 cycles |
33232 cycles |
1.00 |
ML-KEM-1024 encaps |
36925 cycles |
37044 cycles |
1.00 |
ML-KEM-1024 decaps |
47246 cycles |
47104 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 3rd gen (c6a)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
14443 cycles |
14443 cycles |
1 |
ML-KEM-512 encaps |
15959 cycles |
15927 cycles |
1.00 |
ML-KEM-512 decaps |
21374 cycles |
21327 cycles |
1.00 |
ML-KEM-768 keypair |
23679 cycles |
23806 cycles |
0.99 |
ML-KEM-768 encaps |
25126 cycles |
25250 cycles |
1.00 |
ML-KEM-768 decaps |
32832 cycles |
33030 cycles |
0.99 |
ML-KEM-1024 keypair |
33474 cycles |
33344 cycles |
1.00 |
ML-KEM-1024 encaps |
35929 cycles |
35877 cycles |
1.00 |
ML-KEM-1024 decaps |
46192 cycles |
46192 cycles |
1 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 4th gen (c7i) (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
27760 cycles |
27523 cycles |
1.01 |
ML-KEM-512 encaps |
34812 cycles |
35607 cycles |
0.98 |
ML-KEM-512 decaps |
44420 cycles |
44308 cycles |
1.00 |
ML-KEM-768 keypair |
44243 cycles |
44159 cycles |
1.00 |
ML-KEM-768 encaps |
54897 cycles |
54927 cycles |
1.00 |
ML-KEM-768 decaps |
68243 cycles |
68284 cycles |
1.00 |
ML-KEM-1024 keypair |
67469 cycles |
67850 cycles |
0.99 |
ML-KEM-1024 encaps |
78941 cycles |
78888 cycles |
1.00 |
ML-KEM-1024 decaps |
95978 cycles |
96098 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton3
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
18651 cycles |
18665 cycles |
1.00 |
ML-KEM-512 encaps |
21829 cycles |
21857 cycles |
1.00 |
ML-KEM-512 decaps |
28830 cycles |
28837 cycles |
1.00 |
ML-KEM-768 keypair |
31535 cycles |
31576 cycles |
1.00 |
ML-KEM-768 encaps |
34743 cycles |
34667 cycles |
1.00 |
ML-KEM-768 decaps |
44801 cycles |
44803 cycles |
1.00 |
ML-KEM-1024 keypair |
46207 cycles |
46143 cycles |
1.00 |
ML-KEM-1024 encaps |
51380 cycles |
51481 cycles |
1.00 |
ML-KEM-1024 decaps |
64988 cycles |
64971 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton4
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
17669 cycles |
17686 cycles |
1.00 |
ML-KEM-512 encaps |
20547 cycles |
20594 cycles |
1.00 |
ML-KEM-512 decaps |
27012 cycles |
27005 cycles |
1.00 |
ML-KEM-768 keypair |
29871 cycles |
29896 cycles |
1.00 |
ML-KEM-768 encaps |
32699 cycles |
32630 cycles |
1.00 |
ML-KEM-768 decaps |
41917 cycles |
41919 cycles |
1.00 |
ML-KEM-1024 keypair |
43746 cycles |
43717 cycles |
1.00 |
ML-KEM-1024 encaps |
48596 cycles |
48686 cycles |
1.00 |
ML-KEM-1024 decaps |
61421 cycles |
61381 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 3rd gen (c6i) (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
46921 cycles |
46764 cycles |
1.00 |
ML-KEM-512 encaps |
55746 cycles |
55568 cycles |
1.00 |
ML-KEM-512 decaps |
71351 cycles |
71228 cycles |
1.00 |
ML-KEM-768 keypair |
74387 cycles |
74430 cycles |
1.00 |
ML-KEM-768 encaps |
85985 cycles |
85934 cycles |
1.00 |
ML-KEM-768 decaps |
107021 cycles |
107113 cycles |
1.00 |
ML-KEM-1024 keypair |
111438 cycles |
111586 cycles |
1.00 |
ML-KEM-1024 encaps |
126243 cycles |
126184 cycles |
1.00 |
ML-KEM-1024 decaps |
152191 cycles |
152270 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton5 (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
27365 cycles |
27472 cycles |
1.00 |
ML-KEM-512 encaps |
31712 cycles |
31683 cycles |
1.00 |
ML-KEM-512 decaps |
40427 cycles |
40493 cycles |
1.00 |
ML-KEM-768 keypair |
44011 cycles |
44191 cycles |
1.00 |
ML-KEM-768 encaps |
50710 cycles |
50710 cycles |
1 |
ML-KEM-768 decaps |
62119 cycles |
62158 cycles |
1.00 |
ML-KEM-1024 keypair |
68334 cycles |
67977 cycles |
1.01 |
ML-KEM-1024 encaps |
75967 cycles |
76071 cycles |
1.00 |
ML-KEM-1024 decaps |
90694 cycles |
90823 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 4th gen (c7a) (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
37199 cycles |
36791 cycles |
1.01 |
ML-KEM-512 encaps |
42849 cycles |
42839 cycles |
1.00 |
ML-KEM-512 decaps |
55552 cycles |
55590 cycles |
1.00 |
ML-KEM-768 keypair |
58355 cycles |
58027 cycles |
1.01 |
ML-KEM-768 encaps |
67050 cycles |
66923 cycles |
1.00 |
ML-KEM-768 decaps |
83925 cycles |
83737 cycles |
1.00 |
ML-KEM-1024 keypair |
88483 cycles |
88594 cycles |
1.00 |
ML-KEM-1024 encaps |
99111 cycles |
99087 cycles |
1.00 |
ML-KEM-1024 decaps |
120395 cycles |
120547 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton4 (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
35230 cycles |
35280 cycles |
1.00 |
ML-KEM-512 encaps |
40033 cycles |
40025 cycles |
1.00 |
ML-KEM-512 decaps |
50570 cycles |
50626 cycles |
1.00 |
ML-KEM-768 keypair |
56691 cycles |
56804 cycles |
1.00 |
ML-KEM-768 encaps |
64087 cycles |
64045 cycles |
1.00 |
ML-KEM-768 decaps |
78425 cycles |
78496 cycles |
1.00 |
ML-KEM-1024 keypair |
87404 cycles |
87379 cycles |
1.00 |
ML-KEM-1024 encaps |
96484 cycles |
96676 cycles |
1.00 |
ML-KEM-1024 decaps |
114841 cycles |
114706 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 3rd gen (c6a) (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
39913 cycles |
40230 cycles |
0.99 |
ML-KEM-512 encaps |
48250 cycles |
48379 cycles |
1.00 |
ML-KEM-512 decaps |
61661 cycles |
62191 cycles |
0.99 |
ML-KEM-768 keypair |
62550 cycles |
62555 cycles |
1.00 |
ML-KEM-768 encaps |
74792 cycles |
74853 cycles |
1.00 |
ML-KEM-768 decaps |
92264 cycles |
92436 cycles |
1.00 |
ML-KEM-1024 keypair |
95131 cycles |
95010 cycles |
1.00 |
ML-KEM-1024 encaps |
110061 cycles |
109881 cycles |
1.00 |
ML-KEM-1024 decaps |
132664 cycles |
132297 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton2
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
28211 cycles |
28237 cycles |
1.00 |
ML-KEM-512 encaps |
34076 cycles |
34121 cycles |
1.00 |
ML-KEM-512 decaps |
44500 cycles |
44477 cycles |
1.00 |
ML-KEM-768 keypair |
47592 cycles |
47614 cycles |
1.00 |
ML-KEM-768 encaps |
53891 cycles |
53872 cycles |
1.00 |
ML-KEM-768 decaps |
68559 cycles |
68558 cycles |
1.00 |
ML-KEM-1024 keypair |
70166 cycles |
70259 cycles |
1.00 |
ML-KEM-1024 encaps |
78645 cycles |
78638 cycles |
1.00 |
ML-KEM-1024 decaps |
98338 cycles |
98289 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton3 (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
38827 cycles |
38899 cycles |
1.00 |
ML-KEM-512 encaps |
44466 cycles |
44383 cycles |
1.00 |
ML-KEM-512 decaps |
56099 cycles |
56203 cycles |
1.00 |
ML-KEM-768 keypair |
62352 cycles |
62495 cycles |
1.00 |
ML-KEM-768 encaps |
70577 cycles |
70438 cycles |
1.00 |
ML-KEM-768 decaps |
86233 cycles |
86368 cycles |
1.00 |
ML-KEM-1024 keypair |
95826 cycles |
95867 cycles |
1.00 |
ML-KEM-1024 encaps |
105850 cycles |
106090 cycles |
1.00 |
ML-KEM-1024 decaps |
126006 cycles |
125739 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton2 (no-opt)
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
58736 cycles |
58755 cycles |
1.00 |
ML-KEM-512 encaps |
68552 cycles |
68467 cycles |
1.00 |
ML-KEM-512 decaps |
87403 cycles |
87387 cycles |
1.00 |
ML-KEM-768 keypair |
94857 cycles |
94524 cycles |
1.00 |
ML-KEM-768 encaps |
109220 cycles |
108935 cycles |
1.00 |
ML-KEM-768 decaps |
134224 cycles |
134030 cycles |
1.00 |
ML-KEM-1024 keypair |
150872 cycles |
150855 cycles |
1.00 |
ML-KEM-1024 encaps |
165511 cycles |
165563 cycles |
1.00 |
ML-KEM-1024 decaps |
198679 cycles |
198753 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
SpacemiT K1 8 (Banana Pi F3) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
143631 cycles |
143013 cycles |
1.00 |
ML-KEM-512 encaps |
151961 cycles |
151351 cycles |
1.00 |
ML-KEM-512 decaps |
190370 cycles |
189644 cycles |
1.00 |
ML-KEM-768 keypair |
233900 cycles |
233091 cycles |
1.00 |
ML-KEM-768 encaps |
251060 cycles |
250300 cycles |
1.00 |
ML-KEM-768 decaps |
305899 cycles |
304927 cycles |
1.00 |
ML-KEM-1024 keypair |
367025 cycles |
365509 cycles |
1.00 |
ML-KEM-1024 encaps |
389439 cycles |
387853 cycles |
1.00 |
ML-KEM-1024 decaps |
460090 cycles |
458266 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
CBMC Results (ML-KEM-768)Full Results (191 proofs)
|
CBMC Results (ML-KEM-512)Full Results (191 proofs)
|
CBMC Results (ML-KEM-1024)Full Results (191 proofs)
|
oqs-bot
left a comment
There was a problem hiding this comment.
Arm Cortex-M55 (NUCLEO-N657X0-Q) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
727950 cycles |
7850380 cycles |
0.09272799533271 |
ML-KEM-512 encaps |
856828 cycles |
8587300 cycles |
0.09977851012541777 |
ML-KEM-512 decaps |
1090494 cycles |
10952844 cycles |
0.09956263414324171 |
ML-KEM-768 keypair |
1196905 cycles |
12711760 cycles |
0.09415730001195743 |
ML-KEM-768 encaps |
1390354 cycles |
14138090 cycles |
0.09834100645843957 |
ML-KEM-768 decaps |
1705536 cycles |
17499057 cycles |
0.09746445194161034 |
ML-KEM-1024 keypair |
1766592 cycles |
23228659 cycles |
0.07605225940937874 |
ML-KEM-1024 encaps |
1975479 cycles |
25701892 cycles |
0.07686122873755753 |
ML-KEM-1024 decaps |
2370613 cycles |
30573558 cycles |
0.07753801503900855 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Arm Cortex-A55 (Snapdragon 888) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
59810 cycles |
59849 cycles |
1.00 |
ML-KEM-512 encaps |
67491 cycles |
67486 cycles |
1.00 |
ML-KEM-512 decaps |
86491 cycles |
86496 cycles |
1.00 |
ML-KEM-768 keypair |
97501 cycles |
97575 cycles |
1.00 |
ML-KEM-768 encaps |
110987 cycles |
111254 cycles |
1.00 |
ML-KEM-768 decaps |
138794 cycles |
138464 cycles |
1.00 |
ML-KEM-1024 keypair |
154817 cycles |
154791 cycles |
1.00 |
ML-KEM-1024 encaps |
172378 cycles |
172787 cycles |
1.00 |
ML-KEM-1024 decaps |
208461 cycles |
208533 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks
Details
| Benchmark suite | Current: 0e34d09 | Previous: cfd1912 | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
51926 cycles |
52898 cycles |
0.98 |
ML-KEM-512 encaps |
60239 cycles |
60920 cycles |
0.99 |
ML-KEM-512 decaps |
76346 cycles |
78181 cycles |
0.98 |
ML-KEM-768 keypair |
89783 cycles |
88876 cycles |
1.01 |
ML-KEM-768 encaps |
98665 cycles |
97634 cycles |
1.01 |
ML-KEM-768 decaps |
122699 cycles |
121328 cycles |
1.01 |
ML-KEM-1024 keypair |
133541 cycles |
133260 cycles |
1.00 |
ML-KEM-1024 encaps |
145458 cycles |
146057 cycles |
1.00 |
ML-KEM-1024 decaps |
178502 cycles |
178659 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
| return (int)((*((const uint64_t *)a)) - (*((const uint64_t *)b))); | ||
| const uint64_t va = *((const uint64_t *)a); | ||
| const uint64_t vb = *((const uint64_t *)b); | ||
|
|
||
| return (va > vb) - (va < vb); |
There was a problem hiding this comment.
Why was this change made? Some comment would be useful.
| zephyr,memory-region = "DTCM"; | ||
| }; | ||
|
|
||
| mlk_axisram: memory@34080000 { |
There was a problem hiding this comment.
Is this still needed?
hanno-becker
left a comment
There was a problem hiding this comment.
Can you split the cycle counter changes and the memory layout changes in two separate commits?
Use Zephyr's 64-bit cycle counter so long benchmark windows do not wrap, and make benchmark percentile sorting robust for large uint64_t values.
Link NUCLEO-N657X0-Q Zephyr images as XIP from ITCM with runtime data and stacks in DTCM. Force the STM32N6 VTOR setup to the ITCM vector table and scrub the expanded DTCM window in the early reset hook.
Keep project CFLAGS out of Zephyr's cached global CMake flags, and print the Zephyr build log when a suppressed Ninja build fails.
Tested: