Compare commits

Home / Compare 49bf5a9a .. 4d2bc04d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.055-0.054=0.000
min35.218-35.218=-0.000
max35.398-35.397=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.081-0.082=-0.001
σ0.005-0.006=-0.001
min0.075-0.077=-0.001
max0.091-0.095=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.002-0.003=-0.001
min23.766-23.765=0.001
max23.772-23.773=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.068-0.067=0.001
σ0.003-0.005=-0.001
min0.065-0.062=0.004
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.365=-0.001
σ0.367-0.365=0.002
min1755.790-1755.788=0.002
max1756.951-1756.949=0.002
mean1643.150-1646.450=-3.300
σ632.772-637.155=-4.383
min623.000-624.000=-1.000
max2750.000-2828.000=-78.000
mean2.317-2.323=-0.006
σ0.082-0.081=0.001
min2.179-2.189=-0.011
max2.572-2.510=0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.589-324.584=0.005
σ0.042-0.049=-0.006
min324.514-324.499=0.015
max324.613-324.616=-0.003
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean0.422-0.428=-0.006
σ0.001-0.012=-0.011
min0.421-0.421=-0.001
max0.423-0.449=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.145-1985.143=0.002
σ0.018-0.015=0.003
min1985.114-1985.116=-0.002
max1985.157-1985.156=0.002
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean2.620-2.554=0.066
σ0.081-0.028=0.053
min2.558-2.514=0.044
max2.720-2.579=0.140
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.726=0.022
σ7.657-7.678=-0.020
min4805.244-4805.253=-0.009
max4822.446-4822.460=-0.014
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean8.892-8.684=0.208
σ0.309-0.521=-0.212
min8.535-7.775=0.761
max9.289-9.091=0.198
iters=5
new-facts=6402
prior-facts=6402
mean4996.348-4996.348=-0.001
σ0.030-0.018=0.012
min4996.321-4996.325=-0.004
max4996.394-4996.364=0.030
mean3031.200-3035.400=-4.200
σ342.191-187.663=154.528
min2750.000-2828.000=-78.000
max3539.000-3302.000=237.000
mean8.832-8.790=0.042
σ0.709-0.479=0.230
min8.439-8.344=0.095
max10.080-9.544=0.537

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-0.972=0.139
σ0.209-0.067=0.142
min0.948-0.913=0.035
max1.477-1.049=0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.973-462.975=-0.002
σ574.245-574.254=-0.009
min175.839-175.836=0.003
max1324.341-1324.356=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean0.431-0.467=-0.036
σ0.294-0.371=-0.077
min0.280-0.279=0.001
max0.872-1.023=-0.151
policies=20
mean1758.696-1758.702=-0.006
σ0.318-0.372=-0.053
min1758.483-1758.449=0.034
max1759.168-1759.253=-0.086
mean820.000
σ0.000
min820.000
max820.000
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean2.824-2.774=0.051
σ0.065-0.006=0.060
min2.774-2.765=0.009
max2.920-2.778=0.143
policies=200
mean17592.422-17593.342=-0.920
σ0.536-0.644=-0.108
min17592.063-17592.487=-0.424
max17593.220-17593.848=-0.628
mean8200.000
σ0.000
min8200.000
max8200.000
mean2750.000-2828.000=-78.000
σ0.000
min2750.000-2828.000=-78.000
max2750.000-2828.000=-78.000
mean27.239-27.738=-0.499
σ0.146-0.400=-0.254
min27.115-27.394=-0.279
max27.446-28.233=-0.787