Compare commits

Home / Compare 3effdd1e .. 6b260413

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.000
σ0.057-0.053=0.004
min35.213-35.217=-0.004
max35.405-35.394=0.011
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.002
min0.076-0.083=-0.007
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.001
σ0.002-0.002=-0.000
min23.767-23.766=0.001
max23.772-23.772=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.068=-0.003
σ0.003-0.004=-0.001
min0.061-0.062=-0.001
max0.067-0.075=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.000
σ0.364-0.365=-0.001
min1755.911-1755.910=0.001
max1757.072-1757.074=-0.003
mean1628.700-1631.350=-2.650
σ594.497-593.465=1.032
min651.000-654.000=-3.000
max2429.000
mean2.332-2.333=-0.001
σ0.082-0.093=-0.011
min2.221-2.226=-0.005
max2.513-2.583=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.700-324.702=-0.002
σ0.053-0.054=-0.001
min324.607-324.607=-0.000
max324.732-324.735=-0.004
mean2429.000
σ0.000
min2429.000
max2429.000
mean0.428-0.431=-0.003
σ0.008-0.016=-0.007
min0.421-0.423=-0.002
max0.442-0.459=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.260-1985.249=0.011
σ0.016-0.031=-0.015
min1985.233-1985.215=0.018
max1985.276-1985.279=-0.003
mean2429.000
σ0.000
min2429.000
max2429.000
mean2.655-2.683=-0.027
σ0.173-0.275=-0.102
min2.520-2.452=0.068
max2.924-3.156=-0.232
iters=5
new-facts=6402
prior-facts=1
mean4808.868-4808.775=0.093
σ7.717-7.457=0.260
min4805.364-4805.374=-0.010
max4822.672-4822.114=0.558
mean2429.000
σ0.000
min2429.000
max2429.000
mean9.021-9.164=-0.143
σ0.204-0.300=-0.097
min8.807-8.843=-0.036
max9.320-9.613=-0.293
iters=5
new-facts=6402
prior-facts=6402
mean4996.461-4996.467=-0.005
σ0.010-0.011=-0.001
min4996.449-4996.455=-0.005
max4996.472-4996.478=-0.006
mean2941.200-3003.800=-62.600
σ452.330-324.044=128.285
min2429.000-2577.000=-148.000
max3547.000-3415.000=132.000
mean8.506-8.657=-0.151
σ0.095-0.151=-0.056
min8.426-8.499=-0.073
max8.663-8.908=-0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.605-1.740=-0.135
σ0.253-0.157=0.096
min1.214-1.583=-0.369
max1.822-2.004=-0.181

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.944-462.945=-0.000
σ574.250-574.244=0.006
min175.815-175.818=-0.004
max1324.319-1324.311=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2429.000
σ0.000
min2429.000
max2429.000
mean0.569-0.548=0.020
σ0.592-0.560=0.032
min0.271-0.251=0.020
max1.456-1.388=0.068
policies=20
mean1758.483-1758.497=-0.014
σ0.340-0.346=-0.005
min1758.241-1758.261=-0.020
max1758.985-1759.008=-0.023
mean820.000
σ0.000
min820.000
max820.000
mean2429.000
σ0.000
min2429.000
max2429.000
mean2.710-2.712=-0.002
σ0.019-0.028=-0.010
min2.689-2.686=0.004
max2.727-2.752=-0.026
policies=200
mean17592.296-17592.347=-0.050
σ0.549-0.452=0.097
min17591.908-17591.924=-0.016
max17593.108-17592.987=0.121
mean8200.000
σ0.000
min8200.000
max8200.000
mean2429.000
σ0.000
min2429.000
max2429.000
mean27.468-27.406=0.062
σ0.168-0.165=0.002
min27.305-27.259=0.046
max27.670-27.603=0.067