Compare commits

Home / Compare acc2ad63 .. aa52fbc0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.867=-0.083
σ0.046-0.043=0.003
min70.756-70.841=-0.085
max70.913-70.988=-0.075
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.162-0.156=0.006
σ0.004-0.004=-0.001
min0.158-0.151=0.007
max0.170-0.162=0.008
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.002-0.002=0.000
min21.490-21.489=0.001
max21.497-21.496=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.005
max0.071-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.001
σ0.360-0.361=-0.001
min1753.530-1753.533=-0.003
max1754.663-1754.677=-0.015
mean1638.550-1654.150=-15.600
σ615.423-617.691=-2.267
min627.000-655.000=-28.000
max2473.000-2489.000=-16.000
mean2.809-2.817=-0.008
σ0.162-0.143=0.019
min2.320-2.388=-0.068
max2.971-3.114=-0.143

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.600-271.599=0.001
σ0.006-0.006=-0.000
min271.594-271.591=0.003
max271.605-271.605=-0.001
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean0.384-0.380=0.004
σ0.004-0.004=0.000
min0.380-0.376=0.004
max0.389-0.386=0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.999-1931.992=0.007
σ0.011-0.017=-0.005
min1931.980-1931.976=0.004
max1932.008-1932.013=-0.004
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean2.577-2.504=0.074
σ0.106-0.104=0.002
min2.466-2.422=0.045
max2.712-2.679=0.033
iters=5
new-facts=6402
prior-facts=1
mean4752.810-4752.730=0.080
σ0.821-0.902=-0.081
min4752.328-4752.257=0.071
max4754.273-4754.332=-0.059
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean7.882-8.551=-0.668
σ0.417-0.574=-0.157
min7.541-7.571=-0.030
max8.597-8.987=-0.390
iters=5
new-facts=6402
prior-facts=6402
mean4943.155-4943.147=0.007
σ0.145-0.140=0.004
min4942.898-4942.898=0.000
max4943.241-4943.225=0.016
mean2941.400-2935.400=6.000
σ377.533-310.927=66.605
min2473.000-2489.000=-16.000
max3435.000-3318.000=117.000
mean8.539-8.419=0.121
σ0.226-0.088=0.138
min8.351-8.312=0.040
max8.910-8.543=0.367

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.862-1.765=0.097
σ0.022-0.171=-0.149
min1.840-1.499=0.341
max1.893-1.966=-0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.998-479.750=-10.752
σ575.663-597.173=-21.510
min181.164-181.161=0.003
max1332.493-1375.509=-43.017
mean88.250
σ8.500
min84.000
max101.000
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean0.560-0.563=-0.003
σ0.543-0.554=-0.011
min0.287-0.285=0.002
max1.375-1.395=-0.020
policies=20
mean1811.965-1811.922=0.044
σ0.397-0.389=0.008
min1811.693-1811.667=0.026
max1812.549-1812.499=0.050
mean840.000
σ0.000
min840.000
max840.000
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean2.867-2.803=0.065
σ0.025-0.014=0.011
min2.834-2.787=0.047
max2.890-2.821=0.069
policies=200
mean18126.644-18126.781=-0.137
σ0.556-0.498=0.058
min18126.199-18126.471=-0.272
max18127.456-18127.525=-0.068
mean8400.000
σ0.000
min8400.000
max8400.000
mean2473.000-2489.000=-16.000
σ0.000
min2473.000-2489.000=-16.000
max2473.000-2489.000=-16.000
mean28.678-28.444=0.234
σ0.127-0.080=0.047
min28.533-28.351=0.182
max28.832-28.511=0.321