Compare commits

Home / Compare 39db3bd2 .. 96b20831

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-70.373=0.011
σ0.047-0.057=-0.009
min70.356-70.336=0.020
max70.517-70.531=-0.014
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.158=0.001
σ0.003-0.005=-0.002
min0.155-0.148=0.007
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.001
σ0.002-0.003=-0.000
min21.137-21.138=-0.001
max21.146-21.146=-0.001
mean414.000-415.800=-1.800
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.064-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.057=0.006
max0.069-0.064=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.201=0.193
σ0.360-0.361=-0.001
min1751.824-1751.623=0.201
max1752.975-1752.771=0.204
mean1654.400-1652.200=2.200
σ627.581-645.441=-17.860
min618.000-644.000=-26.000
max2769.000-2848.000=-79.000
mean2.806-2.869=-0.063
σ0.190-0.082=0.108
min2.322-2.712=-0.390
max2.981-3.047=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.139-269.937=0.202
σ0.009-0.011=-0.001
min270.131-269.923=0.208
max270.154-269.947=0.206
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean0.377-0.385=-0.008
σ0.004-0.014=-0.010
min0.371-0.371=-0.000
max0.382-0.401=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.403=0.204
σ0.007-0.012=-0.005
min1930.596-1930.390=0.206
max1930.615-1930.418=0.197
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean2.512-2.463=0.049
σ0.085-0.072=0.013
min2.431-2.387=0.043
max2.654-2.580=0.074
iters=5
new-facts=6402
prior-facts=1
mean4751.332-4750.863=0.470
σ0.888-0.802=0.086
min4750.819-4750.277=0.542
max4752.914-4752.258=0.657
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean8.413-8.479=-0.067
σ0.465-0.394=0.071
min7.741-8.083=-0.341
max8.979-9.120=-0.141
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4941.261=0.439
σ0.144-0.129=0.015
min4941.443-4941.072=0.371
max4941.790-4941.437=0.353
mean3044.400-3048.000=-3.600
σ235.302-202.932=32.369
min2769.000-2848.000=-79.000
max3371.000-3326.000=45.000
mean8.680-8.454=0.225
σ0.208-0.111=0.097
min8.394-8.340=0.054
max8.925-8.616=0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.073=-0.053
σ0.117-0.108=0.009
min0.940-0.938=0.001
max1.209-1.241=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.371-465.911=0.459
σ575.930-575.762=0.168
min178.400-178.022=0.378
max1330.266-1329.555=0.711
mean84.250-81.750=2.500
σ8.500-7.500=1.000
min80.000-78.000=2.000
max97.000-93.000=4.000
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean0.448-0.432=0.016
σ0.304-0.302=0.002
min0.293-0.271=0.022
max0.904-0.885=0.019
policies=20
mean1784.336-1780.479=3.857
σ0.336-0.346=-0.010
min1784.101-1780.234=3.867
max1784.823-1780.987=3.836
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean2.847-2.840=0.008
σ0.128-0.006=0.122
min2.780-2.833=-0.054
max3.040-2.847=0.192
policies=200
mean17849.503-17811.417=38.086
σ0.490-0.446=0.044
min17849.216-17811.123=38.093
max17850.235-17812.078=38.157
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2769.000-2848.000=-79.000
σ0.000
min2769.000-2848.000=-79.000
max2769.000-2848.000=-79.000
mean28.008-28.276=-0.268
σ0.113-0.518=-0.405
min27.882-27.792=0.090
max28.156-28.797=-0.642