Compare commits

Home / Compare f9d6cc75 .. 73bbd1ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.048-0.048=-0.001
min33.951-33.951=0.000
max34.110-34.112=-0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.084-0.083=0.001
σ0.003-0.003=0.000
min0.082-0.077=0.005
max0.091-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.316=-0.000
σ0.003-0.002=0.001
min23.311-23.312=-0.001
max23.323-23.319=0.004
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.063-0.063=0.000
σ0.004-0.003=0.000
min0.059-0.059=0.000
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.363=0.065
σ0.364-0.365=-0.000
min1756.855-1756.788=0.066
max1758.016-1757.954=0.062
mean1644.950-1671.800=-26.850
σ625.163-621.000=4.164
min634.000-667.000=-33.000
max2834.000-2682.000=152.000
mean2.372-2.372=0.000
σ0.085-0.097=-0.011
min2.291-2.259=0.032
max2.643-2.670=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.579-326.512=0.066
σ0.041-0.031=0.010
min326.508-326.460=0.048
max326.607-326.541=0.067
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean0.428-0.423=0.005
σ0.007-0.005=0.002
min0.420-0.418=0.001
max0.436-0.431=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.737-1988.672=0.065
σ0.014-0.011=0.003
min1988.719-1988.661=0.058
max1988.753-1988.686=0.067
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean2.713-2.764=-0.051
σ0.122-0.225=-0.103
min2.644-2.501=0.143
max2.930-3.075=-0.145
iters=5
new-facts=6402
prior-facts=1
mean4813.396-4813.551=-0.155
σ7.528-7.724=-0.195
min4809.860-4809.976=-0.116
max4826.862-4827.367=-0.505
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean8.518-8.408=0.109
σ0.724-0.582=0.142
min7.678-7.834=-0.156
max9.262-9.313=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean5001.134-5001.070=0.064
σ0.020-0.029=-0.009
min5001.115-5001.045=0.070
max5001.167-5001.112=0.055
mean3043.400-2973.600=69.800
σ265.779-325.090=-59.311
min2834.000-2682.000=152.000
max3449.000-3440.000=9.000
mean9.238-9.934=-0.697
σ0.499-0.447=0.052
min8.406-9.647=-1.241
max9.755-10.729=-0.974

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-1.067=-0.113
σ0.055-0.250=-0.194
min0.917-0.925=-0.008
max1.050-1.505=-0.454

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.569-464.504=0.065
σ574.769-574.776=-0.007
min177.171-177.110=0.060
max1326.723-1326.669=0.054
mean88.250
σ8.500
min84.000
max101.000
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean0.436-0.546=-0.110
σ0.304-0.547=-0.243
min0.282-0.271=0.011
max0.892-1.366=-0.474
policies=20
mean1772.051-1771.392=0.659
σ0.378-0.360=0.018
min1771.797-1771.165=0.632
max1772.612-1771.928=0.683
mean840.000
σ0.000
min840.000
max840.000
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean2.782-2.740=0.042
σ0.006-0.045=-0.039
min2.776-2.691=0.085
max2.790-2.797=-0.007
policies=200
mean17727.500-17721.050=6.450
σ0.397-0.527=-0.130
min17727.165-17720.716=6.449
max17728.051-17721.831=6.220
mean8400.000
σ0.000
min8400.000
max8400.000
mean2834.000-2682.000=152.000
σ0.000
min2834.000-2682.000=152.000
max2834.000-2682.000=152.000
mean27.872-27.487=0.384
σ0.374-0.139=0.234
min27.495-27.323=0.172
max28.286-27.635=0.650