Compare commits

Home / Compare 38a3b691 .. ea18de99

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.001
σ0.055-0.055=-0.000
min35.588-35.590=-0.002
max35.772-35.774=-0.002
mean411.000-419.000=-8.000
σ0.000
min411.000-419.000=-8.000
max411.000-419.000=-8.000
mean0.081-0.086=-0.005
σ0.004-0.005=-0.000
min0.077-0.082=-0.005
max0.089-0.093=-0.004
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.002-0.002=0.000
min24.045-24.043=0.002
max24.052-24.051=0.002
mean411.000-419.000=-8.000
σ0.000
min411.000-419.000=-8.000
max411.000-419.000=-8.000
mean0.067-0.064=0.003
σ0.001-0.004=-0.003
min0.066-0.061=0.005
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=-0.000
σ0.364-0.366=-0.002
min1755.917-1755.913=0.003
max1757.071-1757.080=-0.009
mean1643.850-1633.800=10.050
σ633.298-592.992=40.305
min618.000-646.000=-28.000
max2828.000-2432.000=396.000
mean2.311-2.330=-0.019
σ0.053-0.083=-0.030
min2.212-2.233=-0.021
max2.417-2.552=-0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.769=-0.008
σ0.042-0.046=-0.004
min324.692-324.687=0.005
max324.790-324.795=-0.004
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean0.423-0.430=-0.007
σ0.010-0.008=0.002
min0.415-0.422=-0.007
max0.438-0.443=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.320=0.006
σ0.007-0.014=-0.007
min1985.319-1985.301=0.018
max1985.334-1985.334=-0.000
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean2.593-2.664=-0.071
σ0.078-0.149=-0.070
min2.501-2.464=0.036
max2.701-2.806=-0.105
iters=5
new-facts=6402
prior-facts=1
mean4808.986-4808.998=-0.012
σ7.777-7.715=0.062
min4805.075-4805.079=-0.005
max4822.889-4822.789=0.101
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean8.992-8.834=0.158
σ0.326-0.430=-0.104
min8.568-8.238=0.329
max9.418-9.367=0.051
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.626=0.005
σ0.017-0.034=-0.017
min4996.612-4996.583=0.030
max4996.646-4996.660=-0.015
mean3036.200-2928.600=107.600
σ216.703-411.732=-195.029
min2828.000-2459.000=369.000
max3345.000-3491.000=-146.000
mean8.611-8.495=0.116
σ0.097-0.106=-0.009
min8.507-8.389=0.118
max8.739-8.665=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.927-1.678=-0.752
σ0.011-0.132=-0.122
min0.919-1.510=-0.591
max0.945-1.807=-0.862

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-463.202=0.013
σ574.778-574.764=0.015
min175.817-175.811=0.006
max1325.382-1325.347=0.035
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean0.427-0.535=-0.109
σ0.289-0.526=-0.238
min0.276-0.270=0.006
max0.859-1.324=-0.465
policies=20
mean1758.535-1758.491=0.044
σ0.345-0.338=0.006
min1758.315-1758.258=0.056
max1759.047-1758.991=0.056
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean2.787-2.717=0.069
σ0.006-0.016=-0.010
min2.778-2.700=0.079
max2.792-2.736=0.056
policies=200
mean17592.064-17592.143=-0.080
σ0.466-0.492=-0.026
min17591.564-17591.883=-0.319
max17592.690-17592.881=-0.191
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2432.000=396.000
σ0.000
min2828.000-2432.000=396.000
max2828.000-2432.000=396.000
mean27.833-27.348=0.484
σ0.403-0.152=0.251
min27.482-27.200=0.282
max28.212-27.492=0.720