Compare commits

Home / Compare b8f00592 .. 37b2422e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.965-35.966=-0.001
σ0.103-0.103=-0.001
min35.923-35.922=0.001
max36.256-36.258=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.076-0.077=-0.002
σ0.005-0.004=0.001
min0.071-0.075=-0.004
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.005=-0.002
min26.203-26.201=0.002
max26.212-26.217=-0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.058-0.061=-0.004
σ0.002-0.002=0.000
min0.056-0.060=-0.004
max0.064-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.307-1756.307=-0.000
σ0.369-0.369=0.001
min1755.731-1755.731=0.000
max1756.899-1756.901=-0.002
mean1675.600-1656.200=19.400
σ633.365-627.619=5.746
min682.000-609.000=73.000
max2683.000-2642.000=41.000
mean2.320-2.364=-0.044
σ0.067-0.175=-0.108
min2.242-2.244=-0.002
max2.440-3.058=-0.618

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.829-278.826=0.003
σ0.005-0.004=0.001
min278.824-278.821=0.003
max278.838-278.832=0.006
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean0.411-0.409=0.002
σ0.005-0.005=-0.001
min0.408-0.405=0.003
max0.419-0.417=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.884-2268.892=-0.008
σ0.006-0.013=-0.008
min2268.874-2268.877=-0.003
max2268.891-2268.914=-0.023
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean2.925-2.995=-0.069
σ0.090-0.111=-0.021
min2.856-2.871=-0.015
max3.083-3.114=-0.031
iters=5
new-facts=6402
prior-facts=1
mean4954.246-4954.264=-0.017
σ0.848-0.804=0.045
min4953.729-4953.813=-0.085
max4955.753-4955.697=0.057
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean8.012-7.922=0.090
σ0.333-0.137=0.196
min7.742-7.828=-0.086
max8.493-8.161=0.332
iters=5
new-facts=6402
prior-facts=6402
mean5168.725-5168.795=-0.070
σ0.203-0.076=0.127
min5168.386-5168.733=-0.348
max5168.885-5168.881=0.004
mean3430.200-3394.600=35.600
σ463.168-491.430=-28.262
min2803.000-2821.000=-18.000
max4016.000-4126.000=-110.000
mean9.463-9.273=0.190
σ0.166-0.280=-0.115
min9.256-8.908=0.348
max9.615-9.668=-0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.157=-0.093
σ0.184-0.403=-0.219
min0.945-0.941=0.004
max1.380-1.872=-0.492

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.351-460.350=0.001
σ572.654-572.654=-0.000
min174.023-174.013=0.009
max1319.331-1319.331=0.001
mean79.500
σ7.000
min76.000
max90.000
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean0.555-0.530=0.025
σ0.571-0.509=0.062
min0.267-0.268=-0.001
max1.411-1.293=0.118
policies=20
mean1740.450-1740.425=0.025
σ0.309-0.319=-0.009
min1740.251-1740.227=0.024
max1740.912-1740.901=0.011
mean760.000
σ0.000
min760.000
max760.000
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean2.679-2.666=0.013
σ0.011-0.015=-0.004
min2.668-2.648=0.020
max2.692-2.680=0.013
policies=200
mean17411.500-17411.411=0.089
σ0.458-0.497=-0.039
min17411.224-17411.077=0.147
max17412.186-17412.147=0.039
mean7600.000
σ0.000
min7600.000
max7600.000
mean2683.000-2642.000=41.000
σ0.000
min2683.000-2642.000=41.000
max2683.000-2642.000=41.000
mean26.936-26.930=0.006
σ0.036-0.142=-0.106
min26.897-26.775=0.121
max26.982-27.114=-0.132