Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Re-enable SNP testing on release #4422

Merged
merged 6 commits into from
Nov 2, 2022
Merged

Re-enable SNP testing on release #4422

merged 6 commits into from
Nov 2, 2022

Conversation

DomAyre
Copy link
Contributor

@DomAyre DomAyre commented Oct 28, 2022

No description provided.

@DomAyre DomAyre requested a review from a team as a code owner October 28, 2022 08:18
@DomAyre DomAyre mentioned this pull request Oct 28, 2022
Closed
13 tasks
@ccf-bot
Copy link
Collaborator

ccf-bot commented Oct 28, 2022 •
edited

reenable-snp-testing@52970 aka 20221102.7 vs main ewma over 20 builds from 52513 to 52956

Click to see table

main

build_id build_number tpcc_virtual_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_virtual_cft^ ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem hist_sgx_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ Commit latency factor
52513 20221028.24 10988.1 5617.3 8.29727e+07 41192.4 10370.2 4321.82 17318.8 1.69124e+07 6079.54 1.56017e+07 3446.62 3193.77 2356.67 9.83456e+06 1971.67 1.19317e+07 28825.8 1953.53 9.31027e+06 920528 1.38753e+06 9.3303e+06 3.47113e+07 nan
52529 20221031.1 11317.6 5554.34 8.32349e+07 42713.1 10189.6 4384.6 17385.6 1.6126e+07 5952.21 1.53396e+07 3465.19 3239.39 2353.33 9.83456e+06 1949.8 9.57242e+06 28320.2 1887.19 9.04813e+06 889422 1.38191e+06 9.39441e+06 3.58036e+07 nan
52542 20221031.6 11057.3 5640.13 8.32349e+07 40617.7 9983.96 4282.55 17419.4 1.63882e+07 5984.67 1.56017e+07 3477.62 3205.73 2359.4 9.83456e+06 1982.98 9.57242e+06 22787.8 1915.42 9.31027e+06 886345 1.36215e+06 9.24184e+06 3.58036e+07 nan
52577 20221031.16 11210.4 5682.73 8.29727e+07 41561.5 10057.5 4133.37 17454.3 1.66503e+07 6017.69 1.53396e+07 3422.54 3247.85 2361.67 9.83456e+06 1989.35 1.19317e+07 24348.4 1926.84 9.04813e+06 901918 1.36441e+06 9.21688e+06 3.58663e+07 nan
52627 20221031.31 10389.6 5461.8 8.24484e+07 36465.4 10643.7 4070.62 15920.2 1.6126e+07 5469.97 1.50774e+07 3376.38 3209.04 2049.2 8.52384e+06 1679.1 9.04813e+06 25417.3 1616.37 7.99955e+06 831354 1.17052e+06 8.15167e+06 3.08058e+07 nan
52629 20221031.32 11537.3 5227.29 8.32349e+07 42144.4 9966.78 4325.53 15549 1.63882e+07 5344.77 1.56017e+07 3326.76 3245.11 2033.02 8.52384e+06 1671.56 9.04813e+06 23577.6 1581.75 7.99955e+06 839644 1.17704e+06 8.15381e+06 3.11544e+07 nan
52633 20221101.2 10922.3 5157.48 8.27106e+07 40768.4 10729.3 4232.88 15554.8 1.63882e+07 5361.14 1.53396e+07 3441.42 3245.17 1998.28 8.78598e+06 1665.53 9.04813e+06 21332.1 1585.35 7.99955e+06 832231 1.181e+06 8.17493e+06 3.13629e+07 nan
52718 20221101.29 10978.6 5534.62 8.29727e+07 40067.5 10392.9 4050.44 16197.8 1.6126e+07 5473.76 1.53396e+07 3419.23 3337.06 2046.41 8.78598e+06 1698.91 8.78598e+06 25803.1 1637.36 7.99955e+06 841238 1.18106e+06 8.15566e+06 3.12958e+07 nan
52744 20221101.38 11456.4 5502.32 8.32349e+07 41041.3 10209.1 4299.1 16097.8 1.63882e+07 5445.07 1.56017e+07 3489.45 3234.76 2031.6 8.78598e+06 1683.42 8.78598e+06 21213.2 1616.71 8.2617e+06 836979 1.17435e+06 8.15754e+06 3.0842e+07 nan
52774 20221101.47 10552.1 5585.58 8.27106e+07 41164.6 10321.5 4279.33 16217.2 1.63882e+07 5417.87 1.53396e+07 3399.1 3125.67 2038.42 8.52384e+06 1691.13 8.52384e+06 25082.2 1626.78 7.73741e+06 837070 1.18686e+06 8.17147e+06 3.11218e+07 nan
52809 20221101.56 11354.1 5483.38 8.29727e+07 40616.9 10066.3 4275.94 15754.8 1.6126e+07 5392.28 1.53396e+07 3714.35 3269.29 2040.53 8.52384e+06 1692.91 8.52384e+06 26058.8 1637.8 7.99955e+06 835548 1.17751e+06 8.14839e+06 3.08248e+07 nan
52836 20221101.65 12975.4 5666.78 8.3497e+07 38685.7 11022.1 3904.35 15879.2 1.53396e+07 5692.48 1.45532e+07 3125.32 2872.24 2058.98 9.04813e+06 1682.43 8.78598e+06 22079.4 1602.04 7.99955e+06 838363 1.18024e+06 8.13493e+06 3.07111e+07 0.840398
52860 20221101.73 16788.9 6273.01 8.21863e+07 45576.9 12595.4 4556.62 16616.8 1.53396e+07 5956.18 1.50774e+07 3453.83 3222.78 2073.62 8.78598e+06 1689.81 8.52384e+06 25456.5 1625.04 7.73741e+06 829373 1.17726e+06 8.17425e+06 3.14656e+07 0.768566
52889 20221101.81 17527.2 6306.08 8.29727e+07 43805.5 12626.2 4401.04 16253.5 1.50774e+07 5941.91 1.50774e+07 3588.18 3362.47 2069.39 8.52384e+06 1702.49 8.78598e+06 29637 1623.71 7.99955e+06 839729 1.17486e+06 8.15592e+06 3.06959e+07 0.782895
52903 20221101.86 17537.9 5669.25 8.27106e+07 43610.3 12588.6 4643.07 16013.7 1.56017e+07 5655.71 1.48153e+07 3561.49 3229.48 2030.98 8.52384e+06 1676.91 8.52384e+06 21617.8 1579.98 7.99955e+06 832062 1.17538e+06 8.16971e+06 3.08824e+07 0.815599
52919 20221101.90 17265.2 5588.57 8.32349e+07 45770.4 12606.2 4582.28 16023.3 1.58639e+07 5721.75 1.48153e+07 3482.84 3361.88 2029.63 8.78598e+06 1684.49 9.04813e+06 24079.5 1613.61 7.99955e+06 838236 1.1826e+06 8.15374e+06 3.08703e+07 0.826385
52928 20221101.94 17061.2 5580.58 8.27106e+07 41901.6 12714.4 4566.57 16062.6 1.53396e+07 5905.59 1.45532e+07 3623.15 3371.65 2035.71 8.78598e+06 1676.17 8.78598e+06 24093.5 1608.74 7.99955e+06 837289 1.17643e+06 8.17102e+06 3.07364e+07 0.816214
52934 20221101.96 17564.9 6266.01 8.19242e+07 43657.7 12483.7 4369.81 16478.7 1.50774e+07 5868.9 1.45532e+07 3604.1 3374.04 2059.88 8.52384e+06 1673.54 8.78598e+06 23964.5 1635.75 7.73741e+06 839550 1.17918e+06 8.16528e+06 3.11417e+07 0.761476
52941 20221101.98 17782.2 6388.18 8.21863e+07 43502.2 12638.7 4433.67 16628 1.50774e+07 5906.45 1.56017e+07 3454.54 3246.07 2099.33 9.31027e+06 1708.45 8.78598e+06 27599.3 1641.61 7.99955e+06 839624 1.17998e+06 8.15316e+06 3.08941e+07 0.800341
52956 20221102.2 17372.4 6382.1 8.21863e+07 41820.9 12622.6 4320.99 16629.9 1.56017e+07 5919.66 1.50774e+07 3451.7 3372.48 2095.36 8.78598e+06 1707.65 8.78598e+06 27099.5 1642.92 7.99955e+06 834176 1.18165e+06 8.15193e+06 3.15976e+07 0.810117

reenable-snp-testing

build_id build_number tpcc_virtual_cft^ ls_virtual_cft^ ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ hist_sgx_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ Commit latency factor
52538 20221031.5 11120.9 36593.6 10421.1 4229.14 3431.61 3196.49 24396.2 5599.75 8.29727e+07 17316.4 1.6126e+07 6038.35 1.53396e+07 2346.37 9.57242e+06 1985.46 9.57242e+06 1916.85 9.04813e+06 919286 1.35127e+06 9.22103e+06 3.57417e+07 nan
52583 20221031.18 11400.5 40715.2 10348.2 4295.76 3479.27 3234.31 23156.6 5714.04 8.40213e+07 17630.4 1.6126e+07 6101.73 1.56017e+07 2307.8 9.57242e+06 1985.79 9.57242e+06 1926.05 9.04813e+06 901997 1.37615e+06 9.25432e+06 3.58669e+07 nan
52760 20221101.43 11014.2 41228.5 10164.2 4285.22 3428.75 3340.04 28223.1 5560.02 8.29727e+07 16094.9 1.6126e+07 5461.33 1.50774e+07 2064.83 9.31027e+06 1684.56 8.52384e+06 1614.33 7.73741e+06 831406 1.17881e+06 8.14398e+06 3.07938e+07 nan
52830 20221101.63 10836.2 39994 9925.34 4119.96 3336.69 3218.97 23348.4 6414 8.24484e+07 16401.8 1.58639e+07 5913.91 1.45532e+07 2070.48 8.52384e+06 1711.83 8.78598e+06 1628.76 7.99955e+06 838550 1.17677e+06 8.15637e+06 3.13601e+07 0.773245
52970 20221102.7 17540.8 45745.6 12510.5 4637.06 3600.5 3353.68 28255.2 6326.46 8.27106e+07 16532.9 1.50774e+07 5883.05 1.45532e+07 2082.12 8.78598e+06 1718.2 8.52384e+06 1642.89 7.99955e+06 832189 1.1765e+06 8.09774e+06 3.06706e+07 0.802372

images

@achamayou achamayou enabled auto-merge (squash) November 1, 2022 11:56
@achamayou achamayou merged commit 70855b5 into microsoft:main Nov 2, 2022
@DomAyre DomAyre deleted the reenable-snp-testing branch November 2, 2022 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jumaffre jumaffre jumaffre approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@DomAyre @ccf-bot @jumaffre @achamayou