Compare commits

Home / Compare 6bb4fbc1 .. d7a987f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-53.971=0.078
σ0.370-0.368=0.002
min53.910-53.826=0.084
max55.102-55.018=0.084
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.138-0.137=0.002
σ0.005-0.006=-0.001
min0.130-0.131=-0.001
max0.146-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.341-43.343=-0.002
σ0.006-0.007=-0.001
min43.330-43.333=-0.003
max43.351-43.353=-0.002
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.120-0.123=-0.002
σ0.005-0.003=0.001
min0.114-0.119=-0.005
max0.129-0.131=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.197-1016.898=0.299
σ1.170-1.181=-0.011
min1016.624-1016.318=0.306
max1022.098-1021.844=0.253
mean1052.600-1061.450=-8.850
σ303.729-310.031=-6.302
min593.000-598.000=-5.000
max1640.000-1619.000=21.000
mean1.538-1.534=0.004
σ0.084-0.082=0.002
min1.464-1.460=0.004
max1.776-1.809=-0.033

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.977-301.989=-0.011
σ0.184-0.222=-0.038
min301.799-301.855=-0.055
max302.444-302.593=-0.149
mean1956.000-1950.000=6.000
σ0.000
min1956.000-1950.000=6.000
max1956.000-1950.000=6.000
mean0.592-0.600=-0.008
σ0.029-0.007=0.022
min0.515-0.586=-0.071
max0.622-0.609=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.785-303.508=0.277
σ0.057-0.062=-0.005
min303.694-303.407=0.286
max303.844-303.566=0.279
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.395-0.391=0.005
σ0.007-0.001=0.006
min0.391-0.390=0.001
max0.408-0.392=0.016
iters=5
new-facts=1
prior-facts=6402
mean1326.320-1326.053=0.266
σ0.104-0.098=0.005
min1326.196-1325.926=0.270
max1326.464-1326.178=0.286
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean1.887-1.984=-0.097
σ0.068-0.092=-0.024
min1.832-1.888=-0.057
max1.996-2.093=-0.097
iters=5
new-facts=6402
prior-facts=1
mean1564.372-1564.143=0.230
σ6.921-6.925=-0.004
min1561.041-1560.782=0.259
max1576.747-1576.524=0.223
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean2.303-2.424=-0.121
σ0.262-0.354=-0.092
min2.089-2.083=0.006
max2.754-2.893=-0.139
iters=5
new-facts=6402
prior-facts=6402
mean1894.289-1894.011=0.278
σ0.077-0.077=-0.000
min1894.151-1893.873=0.278
max1894.329-1894.052=0.276
mean1767.200-1776.400=-9.200
σ132.436-119.094=13.342
min1640.000-1619.000=21.000
max1956.000-1950.000=6.000
mean2.936-2.938=-0.001
σ0.170-0.125=0.045
min2.665-2.814=-0.149
max3.118-3.137=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.290-1.185=0.105
σ0.310-0.380=-0.070
min0.944-0.892=0.052
max1.749-1.816=-0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.342-444.706=3.636
σ581.800-575.148=6.652
min157.436-157.125=0.311
max1321.041-1307.427=13.614
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.539-0.536=0.003
σ0.547-0.545=0.003
min0.263-0.260=0.003
max1.360-1.353=0.007
policies=20
mean1574.621-1571.561=3.060
σ0.346-0.337=0.008
min1574.406-1571.374=3.032
max1575.137-1572.066=3.071
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean2.631-2.640=-0.008
σ0.015-0.011=0.003
min2.615-2.629=-0.015
max2.648-2.655=-0.007
policies=200
mean15754.124-15723.329=30.796
σ0.128-0.076=0.052
min15753.951-15723.235=30.716
max15754.256-15723.420=30.836
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean26.667-26.626=0.041
σ0.247-0.161=0.087
min26.475-26.467=0.008
max27.015-26.806=0.210