Compare commits

Home / Compare 5c07d388 .. e3459a95

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.054-0.054=-0.000
min35.217-35.214=0.003
max35.396-35.396=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.086-0.084=0.003
σ0.005-0.006=-0.002
min0.082-0.076=0.006
max0.096-0.094=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.002
σ0.002-0.002=-0.000
min23.764-23.766=-0.002
max23.772-23.773=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.067=0.000
σ0.003-0.002=0.001
min0.064-0.065=-0.001
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.485=-0.002
σ0.365-0.364=0.001
min1755.910-1755.910=0.000
max1757.077-1757.074=0.003
mean1659.600-1648.350=11.250
σ646.857-639.641=7.216
min628.000-625.000=3.000
max2811.000-2824.000=-13.000
mean2.360-2.343=0.017
σ0.105-0.087=0.019
min2.255-2.150=0.105
max2.713-2.489=0.224

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.712=-0.003
σ0.039-0.036=0.003
min324.639-324.648=-0.009
max324.732-324.740=-0.008
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean0.422-0.422=0.000
σ0.001-0.001=-0.000
min0.421-0.421=0.000
max0.423-0.423=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1985.265=0.006
σ0.007-0.008=-0.001
min1985.264-1985.252=0.012
max1985.282-1985.271=0.011
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean2.615-2.582=0.033
σ0.074-0.060=0.014
min2.552-2.529=0.023
max2.702-2.670=0.032
iters=5
new-facts=6402
prior-facts=1
mean4808.890-4808.867=0.023
σ7.653-7.656=-0.003
min4805.356-4805.359=-0.003
max4822.579-4822.563=0.017
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean8.705-8.726=-0.021
σ0.572-0.217=0.355
min7.712-8.462=-0.750
max9.098-9.013=0.085
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.472=-0.005
σ0.016-0.018=-0.002
min4996.450-4996.447=0.003
max4996.485-4996.492=-0.007
mean3015.800-3041.000=-25.200
σ207.944-190.653=17.291
min2811.000-2824.000=-13.000
max3301.000-3313.000=-12.000
mean8.667-8.898=-0.230
σ0.104-0.306=-0.202
min8.541-8.539=0.001
max8.810-9.375=-0.565

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-0.942=0.007
σ0.054-0.055=-0.001
min0.916-0.906=0.010
max1.042-1.038=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.961=0.005
σ574.249-574.250=-0.001
min175.838-175.830=0.008
max1324.339-1324.336=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean0.424-0.428=-0.004
σ0.291-0.294=-0.002
min0.275-0.277=-0.002
max0.861-0.868=-0.008
policies=20
mean1758.716-1758.690=0.026
σ0.345-0.348=-0.003
min1758.495-1758.462=0.034
max1759.229-1759.207=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean2.784-2.785=-0.001
σ0.005-0.022=-0.017
min2.779-2.771=0.008
max2.789-2.818=-0.028
policies=200
mean17592.527-17593.188=-0.661
σ0.443-0.626=-0.183
min17592.170-17592.316=-0.147
max17593.135-17593.693=-0.558
mean8200.000
σ0.000
min8200.000
max8200.000
mean2811.000-2824.000=-13.000
σ0.000
min2811.000-2824.000=-13.000
max2811.000-2824.000=-13.000
mean27.502-27.778=-0.276
σ0.206-0.343=-0.137
min27.261-27.451=-0.190
max27.764-28.139=-0.375