Compare commits

Home / Compare 0bc90aa5 .. 3b623df5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.710=0.000
σ0.364-0.365=-0.001
min53.574-53.574=0.001
max54.744-54.747=-0.003
mean413.800-417.000=-3.200
σ0.422-0.000=0.422
min413.000-417.000=-4.000
max414.000-417.000=-3.000
mean0.143-0.138=0.005
σ0.009-0.005=0.004
min0.136-0.131=0.005
max0.160-0.146=0.014
cache=y
dps=1
iters=10
policies=100
mean42.978-42.978=0.001
σ0.006-0.006=0.000
min42.965-42.966=-0.001
max42.987-42.988=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.121-0.118=0.003
σ0.003-0.005=-0.002
min0.118-0.113=0.005
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.222-995.220=0.002
σ1.197-1.190=0.007
min994.683-994.686=-0.003
max1000.245-1000.214=0.031
mean1054.800-1053.450=1.350
σ307.343-308.627=-1.284
min595.000-596.000=-1.000
max1554.000-1509.000=45.000
mean1.470-1.496=-0.027
σ0.071-0.138=-0.067
min1.383-1.379=0.004
max1.651-1.997=-0.345

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.320-297.321=-0.001
σ0.004-0.004=0.000
min297.315-297.315=0.000
max297.325-297.324=0.001
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean0.391-0.387=0.004
σ0.006-0.002=0.004
min0.386-0.384=0.002
max0.399-0.390=0.009
iters=5
new-facts=1
prior-facts=6402
mean1299.026-1299.015=0.011
σ0.059-0.094=-0.035
min1298.932-1298.848=0.084
max1299.070-1299.070=-0.000
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean1.873-2.034=-0.161
σ0.039-0.240=-0.201
min1.822-1.834=-0.012
max1.927-2.426=-0.499
iters=5
new-facts=6402
prior-facts=1
mean1719.184-1719.185=-0.001
σ6.943-6.943=-0.000
min1715.918-1715.967=-0.049
max1731.599-1731.602=-0.003
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean3.010-3.102=-0.092
σ0.466-0.426=0.040
min2.533-2.763=-0.230
max3.737-3.805=-0.068
iters=5
new-facts=6402
prior-facts=6402
mean1981.935-1981.929=0.007
σ0.015-0.037=-0.022
min1981.922-1981.867=0.055
max1981.960-1981.966=-0.006
mean1827.400-1799.800=27.600
σ195.147-238.393=-43.246
min1569.000-1524.000=45.000
max2071.000-2134.000=-63.000
mean3.215-3.286=-0.071
σ0.120-0.417=-0.296
min3.063-2.922=0.141
max3.360-4.004=-0.644

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.481-1.513=-0.032
σ0.335-0.320=0.015
min1.027-1.115=-0.088
max1.801-1.798=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.449-440.451=-0.002
σ573.028-573.029=-0.001
min153.930-153.932=-0.002
max1299.991-1299.994=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean0.534-0.558=-0.024
σ0.553-0.596=-0.044
min0.254-0.254=0.000
max1.363-1.453=-0.090
policies=20
mean1539.580-1539.560=0.020
σ0.266-0.255=0.011
min1539.399-1539.389=0.010
max1539.974-1539.937=0.037
mean900.000
σ0.000
min900.000
max900.000
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean2.556-2.580=-0.023
σ0.002-0.038=-0.037
min2.554-2.537=0.017
max2.558-2.630=-0.072
policies=200
mean15404.123-15404.082=0.041
σ0.082-0.099=-0.018
min15404.003-15403.968=0.034
max15404.185-15404.201=-0.016
mean9000.000
σ0.000
min9000.000
max9000.000
mean1554.000-1509.000=45.000
σ0.000
min1554.000-1509.000=45.000
max1554.000-1509.000=45.000
mean25.890-26.086=-0.196
σ0.127-0.180=-0.053
min25.760-25.928=-0.168
max26.016-26.263=-0.247