Compare commits

Home / Compare be922358 .. d03c797c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.711=-0.057
σ0.366-0.362=0.004
min53.517-53.575=-0.059
max54.695-54.739=-0.044
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.138-0.144=-0.006
σ0.003-0.009=-0.006
min0.135-0.135=-0.001
max0.144-0.158=-0.014
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=-0.001
σ0.006-0.006=0.000
min42.974-42.971=0.003
max42.991-42.989=0.002
mean417.000-413.800=3.200
σ0.000-0.422=-0.422
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.120-0.134=-0.014
σ0.005-0.007=-0.003
min0.113-0.120=-0.007
max0.127-0.139=-0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.972-995.218=18.754
σ1.166-1.218=-0.052
min1013.432-994.688=18.744
max1018.853-1000.330=18.523
mean1052.600-1055.200=-2.600
σ316.029-312.357=3.672
min601.000-592.000=9.000
max1656.000-1514.000=142.000
mean1.637-1.472=0.165
σ0.081-0.093=-0.011
min1.558-1.300=0.259
max1.882-1.723=0.158

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.091
σ0.234
min298.899
max299.708
mean1976.000
σ0.000
min1976.000
max1976.000
mean0.575
σ0.018
min0.555
max0.595

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.660-297.311=-2.651
σ0.036-0.015=0.022
min294.615-297.290=-2.674
max294.697-297.329=-2.632
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean0.389-0.386=0.003
σ0.009-0.002=0.008
min0.381-0.384=-0.003
max0.404-0.389=0.015
iters=5
new-facts=1
prior-facts=6402
mean1316.941-1299.004=17.937
σ0.106-0.089=0.016
min1316.880-1298.845=18.034
max1317.129-1299.060=18.069
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean1.930-1.964=-0.033
σ0.086-0.122=-0.036
min1.842-1.851=-0.009
max2.057-2.144=-0.088
iters=5
new-facts=6402
prior-facts=1
mean1555.308-1719.186=-163.879
σ6.901-6.945=-0.043
min1551.971-1715.923=-163.952
max1567.646-1731.605=-163.960
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean2.390-3.009=-0.619
σ0.359-0.463=-0.105
min2.072-2.569=-0.496
max2.908-3.785=-0.878
iters=5
new-facts=6402
prior-facts=6402
mean1884.780-1981.951=-97.171
σ0.041-0.010=0.032
min1884.759-1981.943=-97.184
max1884.854-1981.966=-97.112
mean1793.000-1875.600=-82.600
σ117.011-201.136=-84.126
min1656.000-1605.000=51.000
max1976.000-2087.000=-111.000
mean3.003-3.209=-0.207
σ0.120-0.087=0.033
min2.904-3.109=-0.205
max3.200-3.303=-0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.568=-0.369
σ0.277-0.301=-0.024
min0.910-1.170=-0.259
max1.612-1.813=-0.201

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.571-440.451=0.120
σ573.035-573.026=0.010
min154.047-153.930=0.117
max1300.124-1299.990=0.134
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean0.566-0.538=0.028
σ0.592-0.539=0.053
min0.269-0.265=0.004
max1.453-1.346=0.107
policies=20
mean1540.690-1539.584=1.106
σ0.316-0.296=0.020
min1540.499-1539.388=1.111
max1541.162-1540.022=1.140
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean2.600-2.548=0.052
σ0.010-0.006=0.004
min2.593-2.540=0.053
max2.613-2.553=0.060
policies=200
mean15414.858-15404.078=10.780
σ0.089-0.106=-0.017
min15414.806-15403.982=10.824
max15414.991-15404.219=10.773
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1656.000-1514.000=142.000
σ0.000
min1656.000-1514.000=142.000
max1656.000-1514.000=142.000
mean26.278-25.964=0.314
σ0.165-0.060=0.105
min26.132-25.918=0.214
max26.479-26.046=0.433