Compare commits

Home / Compare cb7585d3 .. ed1ff37f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.373=0.022
σ0.044-0.057=-0.013
min70.370-70.336=0.034
max70.515-70.531=-0.015
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.176-0.158=0.019
σ0.006-0.005=0.001
min0.166-0.148=0.018
max0.185-0.163=0.022
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.002
σ0.003-0.003=0.000
min21.139-21.138=0.001
max21.149-21.146=0.002
mean414.000-415.800=-1.800
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.000
min0.062-0.057=0.005
max0.071-0.064=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.201=0.193
σ0.361-0.361=-0.000
min1751.827-1751.623=0.203
max1752.979-1752.771=0.209
mean1657.100-1652.200=4.900
σ631.122-645.441=-14.319
min623.000-644.000=-21.000
max2770.000-2848.000=-78.000
mean2.809-2.869=-0.060
σ0.186-0.082=0.104
min2.191-2.712=-0.522
max3.086-3.047=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-269.937=0.205
σ0.008-0.011=-0.002
min270.134-269.923=0.212
max270.156-269.947=0.209
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean0.380-0.385=-0.005
σ0.001-0.014=-0.013
min0.378-0.371=0.006
max0.380-0.401=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.403=0.204
σ0.006-0.012=-0.007
min1930.600-1930.390=0.209
max1930.614-1930.418=0.196
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean2.549-2.463=0.085
σ0.082-0.072=0.010
min2.480-2.387=0.092
max2.686-2.580=0.106
iters=5
new-facts=6402
prior-facts=1
mean4751.317-4750.863=0.454
σ0.925-0.802=0.123
min4750.775-4750.277=0.499
max4752.958-4752.258=0.701
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean8.486-8.479=0.007
σ0.536-0.394=0.142
min7.664-8.083=-0.419
max9.062-9.120=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4941.261=0.439
σ0.152-0.129=0.023
min4941.428-4941.072=0.356
max4941.784-4941.437=0.346
mean3017.200-3048.000=-30.800
σ230.775-202.932=27.843
min2770.000-2848.000=-78.000
max3320.000-3326.000=-6.000
mean8.619-8.454=0.165
σ0.241-0.111=0.130
min8.357-8.340=0.017
max8.963-8.616=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.073=-0.042
σ0.122-0.108=0.013
min0.942-0.938=0.003
max1.219-1.241=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.373-465.911=0.462
σ575.918-575.762=0.155
min178.406-178.022=0.384
max1330.250-1329.555=0.695
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean0.445-0.432=0.013
σ0.309-0.302=0.007
min0.288-0.271=0.017
max0.909-0.885=0.024
policies=20
mean1784.354-1780.479=3.875
σ0.344-0.346=-0.002
min1784.108-1780.234=3.874
max1784.853-1780.987=3.866
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean2.841-2.840=0.002
σ0.125-0.006=0.119
min2.768-2.833=-0.066
max3.028-2.847=0.180
policies=200
mean17849.737-17811.417=38.320
σ0.545-0.446=0.099
min17849.310-17811.123=38.188
max17850.532-17812.078=38.454
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2770.000-2848.000=-78.000
σ0.000
min2770.000-2848.000=-78.000
max2770.000-2848.000=-78.000
mean28.006-28.276=-0.270
σ0.154-0.518=-0.365
min27.912-27.792=0.120
max28.236-28.797=-0.561