Compare commits

Home / Compare ba950fb4 .. 42379abb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.372-70.374=-0.001
σ0.059-0.059=-0.000
min70.336-70.334=0.002
max70.537-70.540=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.153-0.158=-0.005
σ0.016-0.006=0.010
min0.113-0.149=-0.036
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.002=0.000
min21.139-21.140=-0.001
max21.147-21.146=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.058-0.057=0.001
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.197=0.005
σ0.362-0.362=-0.000
min1751.633-1751.632=0.001
max1752.787-1752.761=0.025
mean1653.750-1640.800=12.950
σ644.022-613.662=30.361
min630.000-629.000=1.000
max2848.000-2470.000=378.000
mean2.863-2.841=0.022
σ0.071-0.122=-0.051
min2.729-2.603=0.126
max3.006-3.032=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.934=-0.002
σ0.006-0.006=-0.000
min269.925-269.927=-0.002
max269.940-269.943=-0.004
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean0.370-0.382=-0.011
σ0.002-0.011=-0.008
min0.368-0.372=-0.004
max0.374-0.400=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1930.397-1930.386=0.011
σ0.006-0.025=-0.020
min1930.392-1930.357=0.036
max1930.406-1930.411=-0.004
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean2.585-2.566=0.019
σ0.141-0.161=-0.020
min2.459-2.406=0.053
max2.773-2.830=-0.058
iters=5
new-facts=6402
prior-facts=1
mean4750.633-4750.851=-0.217
σ0.736-0.810=-0.074
min4749.944-4750.338=-0.394
max4751.881-4752.278=-0.397
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean8.635-8.637=-0.002
σ0.567-0.224=0.343
min7.793-8.411=-0.618
max9.153-8.925=0.228
iters=5
new-facts=6402
prior-facts=6402
mean4941.336-4941.332=0.004
σ0.079-0.084=-0.005
min4941.265-4941.259=0.006
max4941.430-4941.426=0.004
mean3087.800-2961.600=126.200
σ258.550-272.859=-14.308
min2848.000-2595.000=253.000
max3360.000-3316.000=44.000
mean8.720-8.450=0.270
σ0.325-0.032=0.293
min8.459-8.411=0.048
max9.257-8.495=0.762

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.850=-0.797
σ0.125-0.033=0.091
min0.943-1.813=-0.869
max1.250-1.885=-0.635

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.915-465.903=0.013
σ575.755-575.758=-0.004
min178.032-178.022=0.010
max1329.547-1329.540=0.007
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean0.443-0.550=-0.106
σ0.305-0.531=-0.226
min0.288-0.269=0.019
max0.902-1.346=-0.444
policies=20
mean1780.518-1780.452=0.066
σ0.349-0.356=-0.007
min1780.262-1780.213=0.049
max1781.028-1780.981=0.047
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean2.878-2.767=0.111
σ0.064-0.015=0.049
min2.839-2.751=0.088
max2.973-2.784=0.189
policies=200
mean17811.536-17811.215=0.321
σ0.366-0.409=-0.043
min17811.280-17810.906=0.374
max17812.080-17811.818=0.262
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2470.000=378.000
σ0.000
min2848.000-2470.000=378.000
max2848.000-2470.000=378.000
mean28.263-27.927=0.336
σ0.494-0.109=0.386
min27.708-27.833=-0.126
max28.684-28.051=0.633