Compare commits

Home / Compare 9f81494b .. 06fa96e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.287-1754.048=2.239
σ0.366-0.365=0.001
min1755.711-1753.470=2.241
max1756.881-1754.634=2.247
mean1649.050-1653.150=-4.100
σ631.366-635.853=-4.488
min628.000-620.000=8.000
max2810.000-2605.000=205.000
mean2.228-2.769=-0.541
σ0.069-0.148=-0.079
min2.146-2.472=-0.325
max2.341-3.076=-0.735

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-190.719=87.955
σ0.012-0.004=0.008
min278.658-190.714=87.944
max278.687-190.726=87.961
mean2810.000-2605.000=205.000
σ0.000
min2810.000-2605.000=205.000
max2810.000-2605.000=205.000
mean0.417-0.280=0.137
σ0.001-0.001=0.001
min0.415-0.279=0.136
max0.419-0.281=0.138
iters=5
new-facts=1
prior-facts=6402
mean2268.844-1989.482=279.362
σ0.013-0.027=-0.015
min2268.825-1989.441=279.383
max2268.855-1989.517=279.339
mean2810.000-2605.000=205.000
σ0.000
min2810.000-2605.000=205.000
max2810.000-2605.000=205.000
mean3.103-2.623=0.480
σ0.132-0.339=-0.207
min2.873-2.336=0.538
max3.205-3.142=0.064
iters=5
new-facts=6402
prior-facts=1
mean4952.245-4880.081=72.165
σ0.733-0.594=0.140
min4951.779-4879.734=72.045
max4953.546-4881.132=72.414
mean2810.000-2605.000=205.000
σ0.000
min2810.000-2605.000=205.000
max2810.000-2605.000=205.000
mean7.845-8.234=-0.389
σ0.236-0.104=0.132
min7.623-8.095=-0.472
max8.143-8.329=-0.186
iters=5
new-facts=6402
prior-facts=6402
mean5166.954-4891.693=275.261
σ0.079-0.085=-0.006
min5166.886-4891.623=275.263
max5167.040-4891.794=275.246
mean3349.200-3226.600=122.600
σ448.859-408.603=40.256
min2810.000-2814.000=-4.000
max3783.000-3631.000=152.000
mean9.236-8.269=0.967
σ0.163-0.415=-0.252
min9.040-7.988=1.052
max9.418-8.976=0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.347-1.667=-0.320
σ0.242-0.131=0.112
min1.052-1.470=-0.418
max1.680-1.823=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-456.473=3.782
σ572.607-572.536=0.071
min173.949-170.202=3.747
max1319.166-1315.277=3.889
mean79.500
σ7.000
min76.000
max90.000
mean435.000-432.000=3.000
σ0.000
min435.000-432.000=3.000
max435.000-432.000=3.000
mean0.546-0.529=0.016
σ0.547-0.537=0.010
min0.265-0.259=0.005
max1.366-1.335=0.031
policies=20
mean1739.999-1702.575=37.424
σ0.325-0.317=0.008
min1739.767-1702.337=37.430
max1740.477-1703.037=37.440
mean760.000
σ0.000
min760.000
max760.000
mean445.500-445.750=-0.250
σ9.950-12.010=-2.061
min435.000-433.000=2.000
max454.000-462.000=-8.000
mean2.659-2.629=0.030
σ0.014-0.008=0.006
min2.641-2.624=0.017
max2.673-2.640=0.032
policies=200
mean17409.311-17035.337=373.973
σ0.057-0.154=-0.097
min17409.268-17035.173=374.095
max17409.394-17035.497=373.897
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-490.500=-0.250
σ2.500-2.082=0.418
min487.000-488.000=-1.000
max493.000
mean26.814-26.417=0.397
σ0.104-0.087=0.017
min26.709-26.339=0.370
max26.908-26.512=0.396