Compare commits

Home / Compare a2fbb7b5 .. 4b64e9a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.558-70.559=-0.001
σ0.047-0.047=0.001
min70.530-70.528=0.002
max70.690-70.689=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.156-0.156=0.000
σ0.006-0.005=0.002
min0.148-0.150=-0.003
max0.167-0.162=0.006
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.002-0.003=-0.000
min21.284-21.286=-0.001
max21.291-21.292=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.064=0.001
σ0.002-0.002=0.000
min0.063-0.058=0.005
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.070-1753.070=0.001
σ0.362-0.359=0.003
min1752.501-1752.496=0.005
max1753.658-1753.645=0.013
mean1661.250-1658.650=2.600
σ634.850-634.070=0.780
min619.000-616.000=3.000
max2785.000-2767.000=18.000
mean2.818-2.746=0.073
σ0.106-0.214=-0.108
min2.624-2.145=0.480
max3.035-2.963=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.289-271.289=0.000
σ0.007-0.009=-0.002
min271.279-271.281=-0.002
max271.297-271.304=-0.008
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean0.379-0.380=-0.001
σ0.006-0.006=-0.001
min0.373-0.372=0.002
max0.389-0.388=0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.722-1931.719=0.003
σ0.011-0.015=-0.004
min1931.710-1931.700=0.010
max1931.736-1931.734=0.003
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean2.864-2.929=-0.065
σ0.187-0.308=-0.121
min2.629-2.393=0.235
max3.059-3.143=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4752.434-4752.531=-0.097
σ0.855-0.814=0.041
min4751.998-4752.083=-0.085
max4753.961-4753.983=-0.022
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean8.573-7.944=0.628
σ0.267-0.317=-0.050
min8.251-7.699=0.551
max8.858-8.439=0.419
iters=5
new-facts=6402
prior-facts=6402
mean4942.776-4942.841=-0.064
σ0.196-0.166=0.030
min4942.548-4942.545=0.003
max4942.928-4942.936=-0.008
mean3027.200-3049.200=-22.000
σ220.719-341.825=-121.106
min2785.000-2767.000=18.000
max3310.000-3562.000=-252.000
mean8.681-8.472=0.209
σ0.213-0.181=0.032
min8.405-8.294=0.111
max8.996-8.686=0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.042=-0.023
σ0.139-0.129=0.011
min0.924-0.929=-0.005
max1.242-1.245=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.027-467.028=-0.001
σ575.928-575.924=0.004
min179.051-179.058=-0.006
max1330.920-1330.914=0.006
mean84.250
σ8.500
min80.000
max97.000
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean0.446-0.476=-0.030
σ0.335-0.288=0.047
min0.277-0.272=0.005
max0.949-0.892=0.057
policies=20
mean1790.872-1790.867=0.005
σ0.342-0.321=0.020
min1790.637-1790.635=0.002
max1791.380-1791.342=0.037
mean800.000
σ0.000
min800.000
max800.000
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean2.759-2.769=-0.010
σ0.011-0.020=-0.009
min2.748-2.741=0.007
max2.773-2.786=-0.014
policies=200
mean17915.242-17915.153=0.089
σ0.502-0.388=0.114
min17914.808-17914.841=-0.033
max17915.967-17915.717=0.250
mean8000.000
σ0.000
min8000.000
max8000.000
mean2785.000-2767.000=18.000
σ0.000
min2785.000-2767.000=18.000
max2785.000-2767.000=18.000
mean28.041-27.988=0.053
σ0.194-0.114=0.080
min27.835-27.829=0.006
max28.231-28.073=0.158