Compare commits

Home / Compare 84f0e9ae .. 37ac65a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.001
σ0.046-0.045=0.001
min70.751-70.747=0.004
max70.910-70.905=0.004
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.160-0.158=0.002
σ0.003-0.005=-0.002
min0.156-0.149=0.007
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.000
σ0.003-0.002=0.001
min21.487-21.490=-0.002
max21.495-21.497=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.063=0.001
σ0.003-0.004=-0.001
min0.061-0.060=0.002
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.094=-0.002
σ0.359-0.360=-0.001
min1753.533-1753.535=-0.003
max1754.655-1754.677=-0.021
mean1637.900-1648.850=-10.950
σ618.619-610.118=8.501
min641.000-642.000=-1.000
max2476.000-2469.000=7.000
mean2.869-2.843=0.026
σ0.150-0.137=0.013
min2.507-2.496=0.011
max3.250-2.978=0.272

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.597=0.002
σ0.005-0.005=0.001
min271.592-271.591=0.001
max271.605-271.604=0.001
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean0.386-0.384=0.001
σ0.008-0.004=0.004
min0.380-0.381=-0.001
max0.398-0.390=0.008
iters=5
new-facts=1
prior-facts=6402
mean1931.989-1931.990=-0.001
σ0.018-0.010=0.008
min1931.968-1931.980=-0.012
max1932.006-1932.006=0.000
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean2.617-2.526=0.091
σ0.277-0.079=0.199
min2.456-2.430=0.026
max3.112-2.650=0.462
iters=5
new-facts=6402
prior-facts=1
mean4752.649-4752.538=0.111
σ0.639-0.779=-0.140
min4752.214-4751.659=0.555
max4753.769-4753.787=-0.017
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean8.366-8.283=0.083
σ0.570-0.638=-0.068
min7.608-7.746=-0.138
max8.951-8.982=-0.031
iters=5
new-facts=6402
prior-facts=6402
mean4943.200-4943.212=-0.012
σ0.020-0.024=-0.005
min4943.175-4943.184=-0.009
max4943.222-4943.243=-0.021
mean2966.600-2933.600=33.000
σ267.716-376.943=-109.227
min2621.000-2469.000=152.000
max3320.000-3437.000=-117.000
mean8.538-8.482=0.056
σ0.100-0.147=-0.047
min8.461-8.327=0.134
max8.705-8.678=0.027

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.762-1.835=-0.073
σ0.127-0.028=0.099
min1.610-1.792=-0.181
max1.912-1.863=0.049

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.622-468.626=-0.004
σ574.923-574.922=0.001
min181.159-181.164=-0.005
max1331.006-1331.009=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean0.561-0.565=-0.004
σ0.550-0.543=0.008
min0.283-0.288=-0.005
max1.386-1.378=0.007
policies=20
mean1811.899-1811.957=-0.058
σ0.390-0.399=-0.010
min1811.637-1811.688=-0.051
max1812.474-1812.545=-0.071
mean840.000
σ0.000
min840.000
max840.000
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean2.843-2.851=-0.008
σ0.008-0.025=-0.017
min2.832-2.826=0.006
max2.850-2.883=-0.033
policies=200
mean18126.371-18126.584=-0.212
σ0.398-0.327=0.071
min18126.038-18126.391=-0.353
max18126.949-18127.072=-0.123
mean8400.000
σ0.000
min8400.000
max8400.000
mean2476.000-2469.000=7.000
σ0.000
min2476.000-2469.000=7.000
max2476.000-2469.000=7.000
mean28.657-28.643=0.013
σ0.103-0.143=-0.040
min28.546-28.466=0.080
max28.752-28.796=-0.043