Compare commits

Home / Compare 2f7a3968 .. e6b605df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.707=0.001
σ0.045-0.047=-0.002
min70.679-70.673=0.006
max70.832-70.837=-0.005
mean412.000-412.600=-0.600
σ0.000-0.516=-0.516
min412.000
max412.000-413.000=-1.000
mean0.161-0.160=0.002
σ0.004-0.006=-0.002
min0.157-0.149=0.008
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.411-21.412=-0.001
σ0.002-0.002=0.000
min21.408-21.409=-0.001
max21.414-21.415=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.066-0.063=0.003
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.073-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.935=-0.004
σ0.360-0.360=-0.000
min1754.366-1754.369=-0.003
max1755.511-1755.519=-0.008
mean1664.400-1645.600=18.800
σ626.553-631.817=-5.264
min621.000-622.000=-1.000
max2523.000-2769.000=-246.000
mean2.847-2.893=-0.046
σ0.085-0.148=-0.064
min2.669-2.515=0.154
max3.046-3.226=-0.180

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.793=-0.002
σ0.005-0.007=-0.002
min272.784-272.782=0.002
max272.799-272.800=-0.002
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean0.379-0.378=0.001
σ0.002-0.001=0.001
min0.377-0.377=-0.000
max0.383-0.380=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.217-1933.223=-0.005
σ0.016-0.019=-0.003
min1933.192-1933.200=-0.008
max1933.231-1933.242=-0.012
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean3.082-3.294=-0.212
σ0.088-0.328=-0.240
min3.005-3.019=-0.014
max3.197-3.689=-0.492
iters=5
new-facts=6402
prior-facts=1
mean4756.864-4756.841=0.024
σ7.269-7.637=-0.368
min4753.573-4753.011=0.561
max4769.867-4770.493=-0.626
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean8.328-8.846=-0.517
σ0.317-0.356=-0.039
min7.817-8.504=-0.687
max8.591-9.419=-0.828
iters=5
new-facts=6402
prior-facts=6402
mean4944.451-4944.452=-0.001
σ0.025-0.019=0.006
min4944.424-4944.433=-0.008
max4944.482-4944.477=0.005
mean2981.000-2995.200=-14.200
σ388.844-279.358=109.487
min2523.000-2769.000=-246.000
max3515.000-3416.000=99.000
mean8.476-8.400=0.076
σ0.161-0.038=0.124
min8.346-8.344=0.002
max8.707-8.450=0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.028=0.523
σ0.256-0.132=0.124
min1.227-0.910=0.318
max1.788-1.232=0.556

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.305-468.331=-0.027
σ574.230-574.227=0.003
min181.184-181.208=-0.024
max1329.650-1329.671=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean0.568-0.445=0.124
σ0.571-0.302=0.269
min0.280-0.293=-0.013
max1.424-0.897=0.527
policies=20
mean1812.151-1812.385=-0.234
σ0.382-0.390=-0.009
min1811.901-1812.112=-0.211
max1812.717-1812.958=-0.241
mean840.000
σ0.000
min840.000
max840.000
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean2.807-2.892=-0.085
σ0.012-0.004=0.008
min2.796-2.887=-0.091
max2.821-2.896=-0.075
policies=200
mean18128.999-18129.063=-0.064
σ0.423-0.583=-0.160
min18128.682-18128.619=0.063
max18129.620-18129.921=-0.301
mean8400.000
σ0.000
min8400.000
max8400.000
mean2523.000-2769.000=-246.000
σ0.000
min2523.000-2769.000=-246.000
max2523.000-2769.000=-246.000
mean28.259-28.527=-0.268
σ0.034-0.181=-0.146
min28.208-28.286=-0.077
max28.281-28.707=-0.426