Compare commits

Home / Compare 8dd07121 .. f0dbcf88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.567=-0.006
σ0.047-0.046=0.001
min70.532-70.537=-0.005
max70.693-70.697=-0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.156-0.161=-0.005
σ0.005-0.004=0.002
min0.149-0.155=-0.006
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.005
σ0.013-0.003=0.010
min21.284-21.283=0.001
max21.328-21.291=0.037
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.175=0.000
σ0.360-0.361=-0.001
min1752.605-1752.599=0.006
max1753.752-1753.750=0.002
mean1662.100-1646.900=15.200
σ626.116-637.526=-11.410
min669.000-630.000=39.000
max2677.000-2857.000=-180.000
mean2.862-2.789=0.073
σ0.107-0.154=-0.047
min2.505-2.336=0.169
max3.005-2.944=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.616-271.622=-0.007
σ0.007-0.007=-0.000
min271.609-271.611=-0.001
max271.627-271.628=-0.001
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean0.376-0.380=-0.005
σ0.008-0.007=0.001
min0.371-0.377=-0.006
max0.390-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.040-1932.040=0.001
σ0.006-0.017=-0.012
min1932.033-1932.011=0.022
max1932.045-1932.056=-0.010
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean3.073-2.949=0.124
σ0.085-0.166=-0.081
min2.998-2.757=0.241
max3.198-3.192=0.006
iters=5
new-facts=6402
prior-facts=1
mean4752.622-4752.852=-0.230
σ0.947-0.799=0.148
min4751.933-4752.418=-0.485
max4754.249-4754.279=-0.030
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean7.917-7.922=-0.005
σ0.266-0.350=-0.083
min7.727-7.714=0.013
max8.379-8.540=-0.161
iters=5
new-facts=6402
prior-facts=6402
mean4943.093-4943.157=-0.063
σ0.335-0.149=0.186
min4942.495-4942.891=-0.396
max4943.265-4943.232=0.033
mean2985.800-3086.200=-100.400
σ331.805-307.026=24.780
min2677.000-2857.000=-180.000
max3438.000-3564.000=-126.000
mean8.456-8.459=-0.003
σ0.110-0.114=-0.004
min8.379-8.366=0.013
max8.650-8.648=0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.082-0.994=0.088
σ0.153-0.140=0.013
min0.930-0.929=0.001
max1.255-1.245=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.319-472.315=0.003
σ575.921-575.914=0.007
min184.348-184.358=-0.010
max1336.201-1336.187=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean0.548-0.445=0.103
σ0.521-0.305=0.217
min0.286-0.291=-0.005
max1.330-0.902=0.428
policies=20
mean1843.812-1843.834=-0.022
σ0.400-0.375=0.025
min1843.533-1843.557=-0.024
max1844.402-1844.376=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean2.907-2.969=-0.062
σ0.057-0.038=0.020
min2.871-2.946=-0.074
max2.993-3.025=-0.032
policies=200
mean18444.601-18444.557=0.044
σ0.362-0.446=-0.084
min18444.361-18444.231=0.130
max18445.130-18445.187=-0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2677.000-2857.000=-180.000
σ0.000
min2677.000-2857.000=-180.000
max2677.000-2857.000=-180.000
mean29.069-29.342=-0.273
σ0.228-0.349=-0.121
min28.760-29.035=-0.275
max29.253-29.829=-0.576