Compare commits

Home / Compare 734da65b .. 8468d5b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-35.618=18.296
σ0.366-0.054=0.312
min53.787-35.590=18.198
max54.955-35.771=19.184
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.139-0.083=0.056
σ0.004-0.004=-0.001
min0.135-0.076=0.060
max0.146-0.091=0.055
cache=y
dps=1
iters=10
policies=100
mean43.141-24.047=19.094
σ0.007-0.003=0.004
min43.129-24.042=19.087
max43.151-24.052=19.099
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.068=0.053
σ0.003-0.003=0.001
min0.117-0.066=0.051
max0.128-0.074=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.081-1756.491=-764.409
σ1.232-0.365=0.867
min991.493-1755.915=-764.422
max997.252-1757.082=-759.830
mean1062.700-1654.850=-592.150
σ312.070-645.420=-333.349
min605.000-633.000=-28.000
max1598.000-2846.000=-1248.000
mean1.539-2.357=-0.818
σ0.096-0.138=-0.042
min1.409-2.220=-0.811
max1.816-2.835=-1.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.665-324.772=-39.107
σ0.021-0.036=-0.015
min285.632-324.710=-39.077
max285.685-324.804=-39.119
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean0.375-0.426=-0.050
σ0.001-0.007=-0.006
min0.374-0.421=-0.047
max0.376-0.439=-0.062
iters=5
new-facts=1
prior-facts=6402
mean1285.633-1985.319=-699.685
σ0.123-0.013=0.110
min1285.575-1985.308=-699.733
max1285.853-1985.339=-699.486
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean1.882-2.640=-0.758
σ0.059-0.125=-0.066
min1.808-2.521=-0.714
max1.956-2.824=-0.868
iters=5
new-facts=6402
prior-facts=1
mean1807.994-4809.078=-3001.084
σ6.998-7.717=-0.719
min1804.649-4805.576=-3000.927
max1820.499-4822.883=-3002.384
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean4.269-8.827=-4.557
σ0.171-0.262=-0.091
min4.078-8.434=-4.356
max4.481-9.063=-4.582
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-4996.626=-2926.159
σ0.011-0.028=-0.016
min2070.459-4996.592=-2926.133
max2070.485-4996.655=-2926.170
mean1851.800-3044.600=-1192.800
σ209.992-279.267=-69.274
min1598.000-2846.000=-1248.000
max2087.000-3486.000=-1399.000
mean4.541-8.516=-3.976
σ0.107-0.143=-0.036
min4.416-8.420=-4.005
max4.687-8.768=-4.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.010=0.308
σ0.303-0.137=0.167
min0.985-0.917=0.069
max1.677-1.229=0.448

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.378-463.218=-25.839
σ572.364-574.770=-2.406
min151.194-175.818=-24.624
max1295.924-1325.372=-29.448
mean90.250-86.250=4.000
σ8.500
min86.000-82.000=4.000
max103.000-99.000=4.000
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean0.520-0.432=0.088
σ0.533-0.296=0.238
min0.250-0.281=-0.032
max1.320-0.875=0.444
policies=20
mean1512.173-1758.528=-246.354
σ0.200-0.350=-0.150
min1512.026-1758.292=-246.266
max1512.468-1759.045=-246.577
mean860.000-820.000=40.000
σ0.000
min860.000-820.000=40.000
max860.000-820.000=40.000
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean2.519-2.793=-0.274
σ0.023-0.011=0.012
min2.494-2.784=-0.290
max2.539-2.808=-0.270
policies=200
mean15129.511-17592.092=-2462.581
σ0.414-0.545=-0.131
min15128.898-17591.794=-2462.896
max15129.788-17592.909=-2463.121
mean8600.000-8200.000=400.000
σ0.000
min8600.000-8200.000=400.000
max8600.000-8200.000=400.000
mean1598.000-2846.000=-1248.000
σ0.000
min1598.000-2846.000=-1248.000
max1598.000-2846.000=-1248.000
mean25.592-27.913=-2.321
σ0.116-0.390=-0.274
min25.474-27.493=-2.018
max25.740-28.387=-2.647