Compare commits

Home / Compare 4bd01f09 .. 4425a89e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.645=0.058
σ0.365-0.366=-0.000
min53.566-53.513=0.052
max54.742-54.685=0.057
mean415.000-418.600=-3.600
σ0.000-0.516=-0.516
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.136-0.136=-0.000
σ0.005-0.004=0.000
min0.127-0.132=-0.005
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.977-42.941=0.036
σ0.005-0.007=-0.002
min42.971-42.929=0.042
max42.988-42.950=0.038
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.118-0.121=-0.003
σ0.004-0.003=0.002
min0.113-0.118=-0.005
max0.126-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.902-991.867=3.035
σ1.202-1.211=-0.009
min994.363-991.330=3.032
max999.946-996.927=3.019
mean1061.350-1061.700=-0.350
σ323.131-312.973=10.158
min561.000-590.000=-29.000
max1625.000-1534.000=91.000
mean1.454-1.528=-0.074
σ0.078-0.088=-0.010
min1.390-1.399=-0.009
max1.651-1.792=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.314-285.441=11.873
σ0.008-0.010=-0.002
min297.307-285.426=11.881
max297.328-285.453=11.875
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean0.394-0.381=0.013
σ0.007-0.007=-0.000
min0.387-0.375=0.012
max0.402-0.389=0.012
iters=5
new-facts=1
prior-facts=6402
mean1298.661-1285.487=13.174
σ0.025-0.078=-0.053
min1298.625-1285.354=13.272
max1298.690-1285.536=13.153
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean1.883-1.874=0.009
σ0.050-0.052=-0.002
min1.833-1.825=0.008
max1.964-1.948=0.016
iters=5
new-facts=6402
prior-facts=1
mean1718.875-1705.833=13.042
σ6.934-6.843=0.090
min1715.648-1702.645=13.003
max1731.275-1718.073=13.202
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean2.959-2.930=0.029
σ0.443-0.191=0.252
min2.533-2.650=-0.117
max3.687-3.161=0.526
iters=5
new-facts=6402
prior-facts=6402
mean1981.621-1968.431=13.190
σ0.016-0.012=0.005
min1981.602-1968.423=13.179
max1981.640-1968.452=13.188
mean1880.600-1768.600=112.000
σ194.444-196.133=-1.690
min1625.000-1534.000=91.000
max2087.000-1969.000=118.000
mean3.258-3.103=0.155
σ0.093-0.171=-0.078
min3.143-2.878=0.265
max3.345-3.348=-0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.652=-0.453
σ0.277-0.197=0.079
min0.916-1.337=-0.421
max1.648-1.823=-0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.371-436.767=3.604
σ572.883-572.352=0.530
min153.927-150.589=3.337
max1299.696-1295.296=4.399
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean0.542-0.526=0.016
σ0.573-0.545=0.027
min0.254-0.250=0.005
max1.401-1.344=0.057
policies=20
mean1539.512-1506.169=33.344
σ0.298-0.240=0.058
min1539.325-1506.012=33.313
max1539.956-1506.526=33.430
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean2.558-2.517=0.040
σ0.010-0.001=0.009
min2.548-2.517=0.031
max2.569-2.519=0.050
policies=200
mean15403.078-15069.566=333.512
σ0.057-0.053=0.004
min15403.026-15069.503=333.523
max15403.159-15069.621=333.538
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1625.000-1534.000=91.000
σ0.000
min1625.000-1534.000=91.000
max1625.000-1534.000=91.000
mean25.983-25.452=0.531
σ0.211-0.128=0.083
min25.817-25.281=0.537
max26.259-25.583=0.676