Compare commits

Home / Compare 36b31b3f .. d4424bb7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=0.000
σ0.055-0.056=-0.001
min70.745-70.746=-0.001
max70.935-70.937=-0.002
mean414.700-417.000=-2.300
σ0.483-0.000=0.483
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.160-0.162=-0.002
σ0.003-0.003=0.001
min0.158-0.158=-0.000
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.002-0.003=-0.001
min21.490-21.489=0.001
max21.497-21.497=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.062-0.059=0.002
max0.071-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.121=0.761
σ0.362-0.359=0.002
min1751.313-1750.546=0.767
max1752.474-1751.709=0.765
mean1665.300-1651.000=14.300
σ638.903-636.600=2.303
min678.000-625.000=53.000
max2694.000-2778.000=-84.000
mean2.828-2.782=0.046
σ0.209-0.151=0.058
min2.199-2.462=-0.262
max3.053-3.118=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.381-268.621=0.760
σ0.007-0.005=0.002
min269.372-268.615=0.756
max269.388-268.628=0.760
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean0.376-0.374=0.001
σ0.004-0.004=-0.000
min0.371-0.371=0.001
max0.381-0.381=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1929.739-1929.012=0.728
σ0.013-0.021=-0.008
min1929.722-1928.988=0.734
max1929.751-1929.041=0.710
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean2.990-2.550=0.440
σ0.102-0.106=-0.004
min2.873-2.480=0.393
max3.099-2.734=0.365
iters=5
new-facts=6402
prior-facts=1
mean4750.524-4749.774=0.750
σ0.859-0.834=0.024
min4750.042-4749.275=0.767
max4752.054-4751.261=0.793
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean8.416-8.364=0.051
σ0.443-0.484=-0.041
min7.935-7.710=0.225
max9.043-9.073=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean4940.987-4940.226=0.760
σ0.019-0.019=-0.000
min4940.962-4940.205=0.757
max4941.005-4940.251=0.754
mean2952.200-2980.600=-28.400
σ300.706-263.541=37.165
min2694.000-2778.000=-84.000
max3392.000-3398.000=-6.000
mean8.409-8.402=0.008
σ0.070-0.054=0.016
min8.345-8.344=0.001
max8.523-8.460=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.012=0.069
σ0.207-0.132=0.075
min0.930-0.926=0.004
max1.359-1.228=0.131

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.697-462.698=-0.000
σ574.942-574.922=0.019
min175.221-175.227=-0.007
max1325.110-1325.082=0.028
mean86.250
σ8.500
min82.000
max99.000
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean0.549-0.434=0.115
σ0.536-0.301=0.234
min0.276-0.280=-0.004
max1.352-0.886=0.466
policies=20
mean1752.513-1752.544=-0.031
σ0.349-0.361=-0.012
min1752.290-1752.288=0.001
max1753.035-1753.078=-0.043
mean820.000
σ0.000
min820.000
max820.000
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean2.716-2.818=-0.102
σ0.006-0.097=-0.091
min2.710-2.711=-0.000
max2.724-2.947=-0.223
policies=200
mean17532.313-17532.294=0.020
σ0.477-0.417=0.059
min17531.990-17531.984=0.006
max17533.022-17532.910=0.112
mean8200.000
σ0.000
min8200.000
max8200.000
mean2694.000-2778.000=-84.000
σ0.000
min2694.000-2778.000=-84.000
max2694.000-2778.000=-84.000
mean27.339-27.412=-0.073
σ0.126-0.080=0.046
min27.220-27.358=-0.138
max27.505-27.529=-0.024