Compare commits

Home / Compare 9015a1a1 .. e66e87c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.646=0.001
σ0.369-0.366=0.003
min53.518-53.519=-0.001
max54.696-54.688=0.008
mean414.300-411.300=3.000
σ0.483
min414.000-411.000=3.000
max415.000-412.000=3.000
mean0.138-0.136=0.002
σ0.003-0.004=-0.002
min0.135-0.130=0.005
max0.143-0.143=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.001
σ0.005-0.007=-0.002
min42.933-42.931=0.002
max42.949-42.955=-0.006
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.120-0.120=0.000
σ0.004-0.002=0.002
min0.115-0.118=-0.003
max0.126-0.124=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.857-991.871=-0.014
σ1.214-1.185=0.029
min991.266-991.325=-0.059
max996.938-996.823=0.115
mean1055.450-1051.150=4.300
σ311.661-312.485=-0.823
min585.000-579.000=6.000
max1524.000-1533.000=-9.000
mean1.520-1.530=-0.009
σ0.073-0.092=-0.019
min1.458-1.452=0.006
max1.763-1.787=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.439=-0.003
σ0.013-0.010=0.003
min285.415-285.422=-0.007
max285.448-285.446=0.002
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean0.378-0.377=0.000
σ0.007-0.007=-0.000
min0.374-0.373=0.001
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.501-1285.499=0.002
σ0.087-0.083=0.004
min1285.353-1285.355=-0.002
max1285.568-1285.563=0.005
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean1.888-1.933=-0.046
σ0.066-0.074=-0.007
min1.801-1.824=-0.023
max1.978-2.018=-0.040
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1705.828=0.001
σ6.858-6.859=-0.001
min1702.652-1702.651=0.001
max1718.093-1718.094=-0.001
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean2.963-3.011=-0.048
σ0.224-0.193=0.031
min2.802-2.844=-0.042
max3.309-3.297=0.013
iters=5
new-facts=6402
prior-facts=6402
mean1968.411-1968.430=-0.019
σ0.034-0.009=0.025
min1968.355-1968.419=-0.064
max1968.444-1968.444=0.000
mean1787.200-1818.600=-31.400
σ196.233-219.144=-22.912
min1530.000-1539.000=-9.000
max2030.000-2092.000=-62.000
mean3.216-3.175=0.041
σ0.336-0.299=0.038
min3.014-2.942=0.071
max3.814-3.697=0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.546-1.481=0.066
σ0.264-0.310=-0.046
min1.202-1.071=0.131
max1.782-1.738=0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.771-436.767=0.004
σ572.353-572.353=-0.000
min150.589-150.588=0.001
max1295.301-1295.297=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean0.528-0.532=-0.004
σ0.556-0.564=-0.007
min0.247-0.248=-0.002
max1.363-1.377=-0.015
policies=20
mean1506.174-1506.172=0.001
σ0.238-0.227=0.010
min1506.010-1506.015=-0.005
max1506.526-1506.510=0.017
mean860.000
σ0.000
min860.000
max860.000
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean2.511-2.494=0.016
σ0.025-0.012=0.013
min2.477-2.483=-0.006
max2.531-2.508=0.023
policies=200
mean15069.415-15069.540=-0.126
σ0.101-0.069=0.032
min15069.322-15069.451=-0.130
max15069.553-15069.605=-0.052
mean8600.000
σ0.000
min8600.000
max8600.000
mean1524.000-1533.000=-9.000
σ0.000
min1524.000-1533.000=-9.000
max1524.000-1533.000=-9.000
mean25.443-25.408=0.035
σ0.136-0.079=0.056
min25.317-25.333=-0.016
max25.622-25.495=0.127