Compare commits

Home / Compare 004bf87d .. 126e5daa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.002
σ0.055-0.053=0.003
min35.230-35.231=-0.001
max35.418-35.409=0.009
mean413.000
σ0.000
min413.000
max413.000
mean0.083-0.082=0.001
σ0.004-0.004=-0.000
min0.077-0.076=0.001
max0.088-0.089=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=0.000
min23.764-23.764=0.001
max23.774-23.773=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.067-0.067=-0.000
σ0.005-0.005=0.000
min0.061-0.061=0.000
max0.076-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.366-0.367=-0.001
min1755.909-1755.909=-0.000
max1757.079-1757.077=0.002
mean1646.300-1647.300=-1.000
σ639.692-639.265=0.427
min623.000-626.000=-3.000
max2823.000-2824.000=-1.000
mean2.330-2.314=0.016
σ0.067-0.103=-0.036
min2.238-2.100=0.138
max2.468-2.552=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-324.709=-0.027
σ0.051-0.048=0.003
min324.593-324.624=-0.031
max324.716-324.739=-0.023
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean0.438-0.423=0.015
σ0.017-0.001=0.016
min0.425-0.423=0.002
max0.466-0.424=0.042
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.262=0.004
σ0.010-0.015=-0.005
min1985.250-1985.238=0.011
max1985.274-1985.278=-0.003
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean2.687-2.677=0.010
σ0.163-0.113=0.050
min2.510-2.550=-0.040
max2.890-2.792=0.099
iters=5
new-facts=6402
prior-facts=1
mean4808.672-4808.861=-0.189
σ7.216-7.669=-0.453
min4805.422-4805.404=0.018
max4821.581-4822.580=-0.999
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean9.145-8.799=0.346
σ0.200-0.141=0.059
min8.977-8.614=0.363
max9.469-8.931=0.538
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.466=0.000
σ0.018-0.021=-0.003
min4996.446-4996.431=0.015
max4996.489-4996.482=0.006
mean3029.400-3059.000=-29.600
σ281.789-306.841=-25.053
min2823.000-2824.000=-1.000
max3471.000-3533.000=-62.000
mean8.507-8.561=-0.054
σ0.127-0.296=-0.169
min8.359-8.406=-0.047
max8.699-9.089=-0.390

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.047=-0.073
σ0.067-0.159=-0.092
min0.916-0.895=0.021
max1.052-1.305=-0.253

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.978=-0.006
σ574.256-574.250=0.005
min175.836-175.842=-0.007
max1324.355-1324.353=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean0.431-0.430=0.001
σ0.298-0.296=0.003
min0.278-0.278=-0.000
max0.879-0.874=0.005
policies=20
mean1758.718-1758.716=0.002
σ0.342-0.349=-0.008
min1758.487-1758.478=0.009
max1759.225-1759.233=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean2.799-2.783=0.016
σ0.004-0.008=-0.005
min2.794-2.773=0.021
max2.801-2.792=0.009
policies=200
mean17593.366-17593.349=0.017
σ0.723-0.741=-0.018
min17592.370-17592.336=0.035
max17593.930-17593.928=0.002
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2824.000=-1.000
σ0.000
min2823.000-2824.000=-1.000
max2823.000-2824.000=-1.000
mean27.935-27.828=0.106
σ0.353-0.413=-0.060
min27.588-27.433=0.155
max28.350-28.294=0.056