Compare commits

Home / Compare 14d6abce .. 830efbbb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.263=-1.284
σ0.049-0.054=-0.004
min33.950-35.231=-1.281
max34.115-35.414=-1.299
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.081-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.083=-0.007
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.770=-0.452
σ0.003-0.005=-0.001
min23.312-23.766=-0.454
max23.324-23.782=-0.457
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.067-0.069=-0.002
σ0.004-0.004=-0.000
min0.064-0.066=-0.002
max0.074-0.077=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1756.469=1.022
σ0.364-0.366=-0.002
min1756.919-1755.895=1.024
max1758.083-1757.041=1.042
mean1672.950-1658.400=14.550
σ624.646-642.286=-17.640
min666.000-630.000=36.000
max2695.000-2798.000=-103.000
mean2.382-2.340=0.042
σ0.112-0.109=0.002
min2.275-2.235=0.039
max2.763-2.617=0.145

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.637-324.706=1.932
σ0.048-0.022=0.026
min326.554-324.669=1.885
max326.676-324.723=1.953
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean0.427-0.427=-0.001
σ0.005-0.008=-0.003
min0.421-0.422=-0.001
max0.433-0.442=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.802-1985.249=3.553
σ0.013-0.015=-0.002
min1988.783-1985.225=3.559
max1988.818-1985.260=3.558
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean2.697-2.625=0.072
σ0.145-0.090=0.054
min2.492-2.554=-0.062
max2.896-2.754=0.142
iters=5
new-facts=6402
prior-facts=1
mean4813.648-4808.855=4.793
σ7.752-7.716=0.036
min4810.139-4805.382=4.756
max4827.516-4822.658=4.858
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean8.963-9.044=-0.082
σ0.304-0.186=0.118
min8.693-8.843=-0.150
max9.417-9.291=0.126
iters=5
new-facts=6402
prior-facts=6402
mean5001.057-4996.450=4.606
σ0.196-0.017=0.180
min5000.824-4996.429=4.395
max5001.209-4996.467=4.742
mean3021.200-3042.200=-21.000
σ234.122-309.942=-75.820
min2695.000-2798.000=-103.000
max3316.000-3512.000=-196.000
mean9.619-8.575=1.044
σ0.491-0.114=0.377
min8.753-8.485=0.268
max9.952-8.763=1.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-0.945=0.142
σ0.222-0.054=0.168
min0.917-0.914=0.003
max1.351-1.040=0.310

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-462.952=1.683
σ574.782-574.254=0.528
min177.236-175.814=1.423
max1326.807-1324.333=2.474
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean0.568-0.429=0.139
σ0.593-0.295=0.298
min0.268-0.279=-0.011
max1.457-0.871=0.586
policies=20
mean1772.660-1758.473=14.187
σ0.353-0.354=-0.001
min1772.426-1758.229=14.196
max1773.184-1758.997=14.187
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean2.711-2.839=-0.127
σ0.011-0.091=-0.080
min2.699-2.788=-0.089
max2.726-2.975=-0.249
policies=200
mean17734.035-17590.102=143.933
σ0.554-0.459=0.095
min17733.652-17589.752=143.899
max17734.855-17590.778=144.077
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2695.000-2798.000=-103.000
σ0.000
min2695.000-2798.000=-103.000
max2695.000-2798.000=-103.000
mean27.440-27.425=0.014
σ0.121-0.150=-0.029
min27.299-27.261=0.037
max27.576-27.566=0.010