Compare commits

Home / Compare d7d3cb7d .. 317a1f63

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.057-0.058=-0.001
min70.342-70.336=0.007
max70.534-70.537=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.161-0.157=0.004
σ0.004-0.005=-0.000
min0.152-0.148=0.004
max0.164-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.003=-0.001
min21.140-21.138=0.002
max21.146-21.146=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.063-0.064=-0.001
σ0.006-0.002=0.004
min0.051-0.062=-0.011
max0.073-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=0.000
σ0.361-0.362=-0.002
min1751.630-1751.628=0.003
max1752.787-1752.784=0.003
mean1637.300-1629.750=7.550
σ619.260-607.058=12.202
min629.000-625.000=4.000
max2477.000-2448.000=29.000
mean2.748-2.773=-0.025
σ0.191-0.180=0.012
min2.349-2.354=-0.006
max3.001-3.025=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.938-269.933=0.006
σ0.009-0.007=0.002
min269.926-269.925=0.002
max269.951-269.944=0.007
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean0.386-0.378=0.008
σ0.007-0.008=-0.000
min0.382-0.371=0.011
max0.399-0.389=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1930.384=0.009
σ0.010-0.024=-0.014
min1930.375-1930.351=0.024
max1930.401-1930.403=-0.003
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean2.524-2.560=-0.036
σ0.067-0.137=-0.070
min2.462-2.454=0.007
max2.599-2.785=-0.186
iters=5
new-facts=6402
prior-facts=1
mean4750.565-4750.728=-0.163
σ0.835-0.892=-0.057
min4749.353-4750.052=-0.699
max4751.711-4752.284=-0.572
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean8.188-8.600=-0.413
σ0.553-0.211=0.342
min7.712-8.355=-0.643
max9.042-8.896=0.145
iters=5
new-facts=6402
prior-facts=6402
mean4941.325-4941.330=-0.005
σ0.076-0.081=-0.005
min4941.265-4941.258=0.007
max4941.408-4941.421=-0.013
mean2958.600-2960.000=-1.400
σ429.464-263.358=166.106
min2477.000-2603.000=-126.000
max3543.000-3303.000=240.000
mean8.440-8.582=-0.142
σ0.123-0.149=-0.026
min8.316-8.459=-0.143
max8.643-8.802=-0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.796-1.800=-0.004
σ0.119-0.216=-0.097
min1.593-1.566=0.028
max1.897-2.102=-0.205

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.910-465.911=-0.001
σ575.767-575.765=0.002
min178.021-178.024=-0.003
max1329.560-1329.558=0.002
mean81.750
σ7.500
min78.000
max93.000
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean0.571-0.578=-0.007
σ0.577-0.595=-0.018
min0.278-0.275=0.003
max1.437-1.471=-0.034
policies=20
mean1780.465-1780.478=-0.013
σ0.366-0.368=-0.002
min1780.221-1780.225=-0.004
max1781.007-1781.023=-0.016
mean780.000
σ0.000
min780.000
max780.000
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean2.771-2.772=-0.001
σ0.008-0.019=-0.011
min2.760-2.754=0.006
max2.776-2.796=-0.020
policies=200
mean17811.408-17811.530=-0.122
σ0.436-0.515=-0.079
min17811.093-17811.220=-0.127
max17812.051-17812.300=-0.249
mean7800.000
σ0.000
min7800.000
max7800.000
mean2477.000-2448.000=29.000
σ0.000
min2477.000-2448.000=29.000
max2477.000-2448.000=29.000
mean27.859-27.774=0.085
σ0.093-0.032=0.062
min27.771-27.745=0.025
max27.988-27.805=0.184