Compare commits

Home / Compare 5eeb913d .. 9c68065f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.967=0.007
σ0.106-0.103=0.004
min35.925-35.922=0.003
max36.276-36.258=0.018
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.078-0.077=0.001
σ0.004-0.004=-0.000
min0.073-0.074=-0.001
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.004=-0.001
min26.203-26.203=0.000
max26.212-26.215=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.060=0.000
σ0.003-0.003=-0.000
min0.058-0.058=0.000
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.314=2.051
σ0.371-0.369=0.002
min1757.788-1755.739=2.049
max1758.956-1756.908=2.047
mean1664.850-1657.850=7.000
σ644.072-628.019=16.053
min678.000-612.000=66.000
max2828.000-2707.000=121.000
mean2.344-2.382=-0.038
σ0.066-0.128=-0.062
min2.259-2.262=-0.003
max2.467-2.812=-0.345

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.369-278.842=-7.473
σ18.207-0.009=18.198
min238.799-278.826=-40.027
max279.520-278.849=0.671
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean0.394-0.416=-0.022
σ0.029-0.006=0.023
min0.343-0.408=-0.065
max0.407-0.424=-0.017
iters=5
new-facts=1
prior-facts=6402
mean2178.437-2268.906=-90.468
σ0.010-0.007=0.003
min2178.426-2268.893=-90.466
max2178.451-2268.910=-90.459
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean3.365-2.963=0.402
σ0.148-0.138=0.011
min3.169-2.874=0.295
max3.538-3.207=0.331
iters=5
new-facts=6402
prior-facts=1
mean5056.255-4954.151=102.104
σ1.099-0.941=0.158
min5055.302-4953.433=101.869
max5058.150-4955.802=102.348
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean8.752-8.070=0.681
σ0.637-0.369=0.269
min8.091-7.700=0.390
max9.735-8.604=1.131
iters=5
new-facts=6402
prior-facts=6402
mean4994.406-5168.813=-174.407
σ445.732-0.083=445.650
min4197.056-5168.744=-971.688
max5193.862-5168.905=24.958
mean3207.000-3421.000=-214.000
σ275.548-459.802=-184.254
min2828.000-2778.000=50.000
max3563.000-3987.000=-424.000
mean8.500-9.279=-0.779
σ0.539-0.310=0.229
min7.551-8.917=-1.366
max8.899-9.770=-0.871

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.056=-0.062
σ0.069-0.131=-0.062
min0.932-0.940=-0.009
max1.070-1.263=-0.194

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.492-460.360=5.132
σ572.655-572.653=0.001
min179.159-174.029=5.130
max1324.474-1319.340=5.134
mean79.500
σ7.000
min76.000
max90.000
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean0.438-0.541=-0.104
σ0.303-0.534=-0.231
min0.283-0.269=0.014
max0.892-1.343=-0.451
policies=20
mean1791.840-1740.499=51.341
σ0.345-0.319=0.026
min1791.602-1740.293=51.310
max1792.347-1740.974=51.373
mean760.000
σ0.000
min760.000
max760.000
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean2.886-2.678=0.208
σ0.006-0.009=-0.003
min2.880-2.666=0.215
max2.894-2.685=0.209
policies=200
mean17923.740-17411.944=511.796
σ0.557-0.450=0.108
min17923.221-17411.705=511.516
max17924.285-17412.618=511.667
mean7600.000
σ0.000
min7600.000
max7600.000
mean2828.000-2707.000=121.000
σ0.000
min2828.000-2707.000=121.000
max2828.000-2707.000=121.000
mean28.413-26.979=1.434
σ0.356-0.034=0.322
min28.119-26.944=1.175
max28.929-27.026=1.903