Compare commits

Home / Compare 93451ce3 .. cb2b5ed5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.376=0.003
σ0.046-0.059=-0.013
min70.347-70.337=0.010
max70.506-70.540=-0.034
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.159-0.157=0.002
σ0.003-0.005=-0.002
min0.155-0.148=0.007
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.001
σ0.002-0.002=0.000
min21.141-21.139=0.002
max21.150-21.148=0.002
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.062-0.064=-0.003
σ0.004-0.003=0.001
min0.058-0.062=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.202=0.186
σ0.362-0.363=-0.001
min1751.816-1751.624=0.193
max1752.970-1752.779=0.192
mean1649.400-1654.100=-4.700
σ641.603-645.522=-3.919
min617.000-632.000=-15.000
max2774.000-2848.000=-74.000
mean2.840-2.822=0.018
σ0.160-0.160=-0.001
min2.368-2.375=-0.007
max3.196-3.044=0.151

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-269.929=0.198
σ0.005-0.009=-0.004
min270.123-269.920=0.203
max270.137-269.944=0.193
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean0.374-0.372=0.002
σ0.005-0.004=0.001
min0.371-0.368=0.002
max0.383-0.378=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.587-1930.396=0.191
σ0.018-0.009=0.009
min1930.558-1930.384=0.174
max1930.601-1930.407=0.195
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean2.511-2.549=-0.038
σ0.132-0.124=0.009
min2.308-2.435=-0.127
max2.641-2.706=-0.065
iters=5
new-facts=6402
prior-facts=1
mean4751.128-4750.653=0.474
σ0.788-0.360=0.428
min4750.686-4750.422=0.264
max4752.532-4751.290=1.242
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean8.145-8.656=-0.511
σ0.322-0.589=-0.268
min7.720-7.767=-0.046
max8.547-9.327=-0.780
iters=5
new-facts=6402
prior-facts=6402
mean4941.526-4941.262=0.264
σ0.086-0.206=-0.120
min4941.450-4940.923=0.527
max4941.625-4941.436=0.189
mean3052.200-3057.600=-5.400
σ339.321-225.435=113.886
min2774.000-2848.000=-74.000
max3563.000-3392.000=171.000
mean8.469-8.501=-0.032
σ0.156-0.110=0.046
min8.308-8.367=-0.059
max8.703-8.666=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-1.017=0.058
σ0.177-0.120=0.056
min0.932-0.932=-0.001
max1.367-1.209=0.158

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.372-465.923=0.449
σ575.941-575.778=0.163
min178.394-178.027=0.367
max1330.284-1329.591=0.693
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean0.442-0.441=0.001
σ0.308-0.309=-0.001
min0.284-0.284=-0.000
max0.904-0.905=-0.001
policies=20
mean1784.246-1780.508=3.738
σ0.339-0.363=-0.024
min1783.987-1780.252=3.735
max1784.740-1781.040=3.699
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean2.890-2.846=0.044
σ0.094-0.009=0.085
min2.776-2.838=-0.061
max2.970-2.859=0.111
policies=200
mean17848.882-17811.565=37.317
σ0.490-0.419=0.071
min17848.594-17811.292=37.302
max17849.616-17812.189=37.427
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2774.000-2848.000=-74.000
σ0.000
min2774.000-2848.000=-74.000
max2774.000-2848.000=-74.000
mean28.003-28.340=-0.337
σ0.110-0.521=-0.412
min27.892-27.805=0.087
max28.154-28.901=-0.748