Compare commits

Home / Compare 8478817c .. c25ad415

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.374=0.002
σ0.057-0.058=-0.001
min70.340-70.339=0.001
max70.534-70.533=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.162-0.158=0.004
σ0.002-0.005=-0.003
min0.158-0.151=0.006
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.001-0.003=-0.001
min21.140-21.140=0.000
max21.144-21.147=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.201=-0.002
σ0.359-0.362=-0.003
min1751.628-1751.627=0.001
max1752.779-1752.782=-0.003
mean1653.400-1658.200=-4.800
σ614.705-624.328=-9.623
min644.000-683.000=-39.000
max2486.000-2738.000=-252.000
mean2.800-2.833=-0.033
σ0.197-0.098=0.099
min2.171-2.645=-0.474
max3.101-3.015=0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.936-269.936=0.000
σ0.007-0.006=0.001
min269.928-269.929=-0.001
max269.945-269.946=-0.000
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean0.379-0.387=-0.008
σ0.009-0.017=-0.008
min0.370-0.369=0.001
max0.393-0.411=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.390-1930.402=-0.013
σ0.017-0.004=0.013
min1930.371-1930.399=-0.028
max1930.405-1930.408=-0.003
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean2.605-2.540=0.065
σ0.148-0.082=0.066
min2.466-2.456=0.010
max2.829-2.669=0.161
iters=5
new-facts=6402
prior-facts=1
mean4750.925-4750.923=0.002
σ0.785-0.822=-0.037
min4750.535-4750.443=0.092
max4752.328-4752.382=-0.054
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean8.171-8.211=-0.041
σ0.347-0.447=-0.100
min7.842-7.735=0.107
max8.656-8.791=-0.134
iters=5
new-facts=6402
prior-facts=6402
mean4941.258-4941.328=-0.071
σ0.130-0.076=0.054
min4941.058-4941.269=-0.211
max4941.422-4941.423=-0.001
mean2964.800-3031.400=-66.600
σ434.269-346.121=88.148
min2486.000-2738.000=-252.000
max3551.000-3540.000=11.000
mean8.476-8.514=-0.038
σ0.206-0.183=0.023
min8.304-8.385=-0.080
max8.770-8.793=-0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.679-1.055=0.623
σ0.134-0.275=-0.141
min1.502-0.927=0.575
max1.859-1.548=0.311

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.905-465.917=-0.012
σ575.762-575.771=-0.008
min178.023-178.024=-0.002
max1329.548-1329.573=-0.025
mean81.750
σ7.500
min78.000
max93.000
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean0.561-0.558=0.002
σ0.545-0.550=-0.005
min0.284-0.280=0.004
max1.379-1.384=-0.005
policies=20
mean1780.450-1780.476=-0.027
σ0.354-0.350=0.004
min1780.215-1780.232=-0.018
max1780.976-1780.995=-0.019
mean780.000
σ0.000
min780.000
max780.000
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean2.764-2.770=-0.006
σ0.009-0.017=-0.008
min2.754-2.761=-0.007
max2.774-2.795=-0.022
policies=200
mean17811.498-17811.197=0.301
σ0.496-0.762=-0.265
min17811.196-17810.667=0.529
max17812.240-17812.309=-0.069
mean7800.000
σ0.000
min7800.000
max7800.000
mean2486.000-2738.000=-252.000
σ0.000
min2486.000-2738.000=-252.000
max2486.000-2738.000=-252.000
mean27.926-27.917=0.009
σ0.065-0.124=-0.058
min27.863-27.826=0.037
max28.017-28.097=-0.079