Compare commits

Home / Compare b2b7ca12 .. 51405db3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.707-53.648=0.060
σ0.364-0.368=-0.005
min53.576-53.517=0.059
max54.742-54.696=0.046
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.146-0.139=0.007
σ0.010-0.003=0.007
min0.135-0.135=-0.001
max0.161-0.144=0.017
cache=y
dps=1
iters=10
policies=100
mean42.984-42.943=0.041
σ0.004-0.006=-0.001
min42.975-42.933=0.042
max42.991-42.952=0.040
mean416.200-414.000=2.200
σ0.632-0.000=0.632
min416.000-414.000=2.000
max418.000-414.000=4.000
mean0.142-0.120=0.022
σ0.004-0.002=0.002
min0.138-0.119=0.019
max0.148-0.125=0.023

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.903-991.868=3.035
σ1.200-1.219=-0.019
min994.363-991.284=3.080
max999.938-996.952=2.987
mean1060.150-1066.100=-5.950
σ316.667-323.037=-6.370
min599.000-576.000=23.000
max1620.000-1633.000=-13.000
mean1.457-1.519=-0.063
σ0.069-0.122=-0.053
min1.407-1.327=0.081
max1.709-1.903=-0.193

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.311-285.438=11.873
σ0.012-0.009=0.003
min297.294-285.425=11.869
max297.326-285.448=11.879
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean0.390-0.376=0.014
σ0.006-0.006=0.000
min0.383-0.373=0.010
max0.398-0.387=0.011
iters=5
new-facts=1
prior-facts=6402
mean1298.694-1285.489=13.205
σ0.036-0.081=-0.046
min1298.633-1285.353=13.279
max1298.725-1285.548=13.177
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean1.960-1.920=0.040
σ0.155-0.159=-0.004
min1.820-1.803=0.016
max2.162-2.192=-0.030
iters=5
new-facts=6402
prior-facts=1
mean1718.876-1705.833=13.043
σ6.893-6.829=0.064
min1715.678-1702.652=13.026
max1731.204-1718.046=13.158
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean2.841-3.026=-0.185
σ0.296-0.169=0.127
min2.511-2.827=-0.316
max3.321-3.230=0.091
iters=5
new-facts=6402
prior-facts=6402
mean1981.589-1968.444=13.146
σ0.030-0.022=0.008
min1981.537-1968.427=13.111
max1981.609-1968.475=13.134
mean1810.600-1904.400=-93.800
σ208.070-225.186=-17.116
min1620.000-1633.000=-13.000
max2113.000-2183.000=-70.000
mean3.349-3.250=0.099
σ0.396-0.102=0.294
min3.100-3.166=-0.067
max4.052-3.367=0.685

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.300-1.209=0.091
σ0.436-0.335=0.102
min0.935-0.916=0.020
max1.790-1.775=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.374-436.780=3.594
σ572.881-572.362=0.519
min153.931-150.590=3.341
max1299.695-1295.323=4.372
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean0.515-0.529=-0.014
σ0.511-0.557=-0.046
min0.257-0.248=0.009
max1.282-1.365=-0.083
policies=20
mean1539.514-1506.183=33.331
σ0.304-0.237=0.067
min1539.319-1506.031=33.288
max1539.966-1506.537=33.430
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean2.570-2.518=0.051
σ0.021-0.019=0.002
min2.544-2.492=0.052
max2.595-2.535=0.061
policies=200
mean15403.189-15069.438=333.751
σ0.024-0.120=-0.096
min15403.165-15069.284=333.881
max15403.221-15069.572=333.649
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1620.000-1633.000=-13.000
σ0.000
min1620.000-1633.000=-13.000
max1620.000-1633.000=-13.000
mean26.136-25.409=0.727
σ0.179-0.095=0.084
min25.888-25.301=0.587
max26.299-25.519=0.781