Compare commits

Home / Compare c777606d .. 77cd5713

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.381=-0.003
σ0.046-0.047=-0.000
min70.350-70.352=-0.003
max70.506-70.509=-0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.152-0.159=-0.007
σ0.005-0.009=-0.004
min0.148-0.150=-0.002
max0.159-0.181=-0.022
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.000
min21.139-21.141=-0.002
max21.148-21.148=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.064=-0.000
σ0.002-0.002=-0.000
min0.063-0.062=0.000
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.387=0.001
σ0.363-0.361=0.001
min1751.818-1751.820=-0.002
max1752.977-1752.973=0.004
mean1658.350-1651.400=6.950
σ638.373-642.373=-4.000
min619.000-631.000=-12.000
max2811.000-2847.000=-36.000
mean2.828-2.775=0.053
σ0.144-0.145=-0.000
min2.289-2.495=-0.206
max3.053-3.013=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.125-270.114=0.011
σ0.009-0.013=-0.004
min270.114-270.096=0.018
max270.139-270.133=0.006
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean0.373-0.375=-0.002
σ0.001-0.004=-0.003
min0.371-0.371=0.000
max0.373-0.381=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.589=0.002
σ0.005-0.017=-0.012
min1930.587-1930.564=0.023
max1930.599-1930.604=-0.005
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean2.483-2.579=-0.097
σ0.074-0.115=-0.041
min2.377-2.430=-0.054
max2.554-2.722=-0.168
iters=5
new-facts=6402
prior-facts=1
mean4751.055-4751.127=-0.072
σ0.844-0.813=0.031
min4750.484-4750.667=-0.184
max4752.550-4752.572=-0.022
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean8.493-8.124=0.370
σ0.583-0.510=0.073
min7.607-7.780=-0.174
max9.078-9.016=0.062
iters=5
new-facts=6402
prior-facts=6402
mean4941.530-4941.524=0.006
σ0.091-0.074=0.017
min4941.454-4941.459=-0.005
max4941.632-4941.604=0.029
mean3031.200-3081.600=-50.400
σ222.036-309.385=-87.348
min2811.000-2847.000=-36.000
max3332.000-3561.000=-229.000
mean8.590-8.382=0.208
σ0.185-0.141=0.044
min8.421-8.254=0.167
max8.870-8.621=0.249

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.073=-0.020
σ0.129-0.108=0.021
min0.927-0.938=-0.011
max1.252-1.240=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.362-466.363=-0.001
σ575.916-575.919=-0.003
min178.398-178.394=0.004
max1330.236-1330.242=-0.006
mean84.000
σ8.000
min80.000
max96.000
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean0.402-0.441=-0.039
σ0.258-0.305=-0.047
min0.265-0.286=-0.021
max0.789-0.899=-0.110
policies=20
mean1784.253-1784.276=-0.022
σ0.354-0.362=-0.008
min1784.016-1784.030=-0.014
max1784.776-1784.810=-0.034
mean800.000
σ0.000
min800.000
max800.000
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean2.876-2.856=0.020
σ0.119-0.009=0.110
min2.765-2.845=-0.080
max3.045-2.863=0.181
policies=200
mean17848.922-17848.886=0.036
σ0.458-0.372=0.086
min17848.648-17848.605=0.043
max17849.606-17849.433=0.174
mean8000.000
σ0.000
min8000.000
max8000.000
mean2811.000-2847.000=-36.000
σ0.000
min2811.000-2847.000=-36.000
max2811.000-2847.000=-36.000
mean28.026-28.381=-0.355
σ0.197-0.504=-0.306
min27.856-27.862=-0.006
max28.308-28.862=-0.553