Compare commits

Home / Compare bdcd05ad .. be922358

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.709=0.002
σ0.362-0.364=-0.002
min53.575-53.571=0.004
max54.739-54.743=-0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.144-0.139=0.005
σ0.009-0.004=0.005
min0.135-0.134=0.001
max0.158-0.144=0.014
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.006-0.004=0.002
min42.971-42.975=-0.004
max42.989-42.988=0.002
mean413.800-412.000=1.800
σ0.422-0.000=0.422
min413.000-412.000=1.000
max414.000-412.000=2.000
mean0.134-0.121=0.013
σ0.007-0.006=0.002
min0.120-0.117=0.003
max0.139-0.137=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.218-995.218=0.001
σ1.218-1.197=0.021
min994.688-994.677=0.011
max1000.330-1000.240=0.090
mean1055.200-1062.000=-6.800
σ312.357-313.094=-0.737
min592.000-603.000=-11.000
max1514.000-1632.000=-118.000
mean1.472-1.462=0.010
σ0.093-0.067=0.026
min1.300-1.315=-0.015
max1.723-1.573=0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.311-297.318=-0.006
σ0.015-0.011=0.004
min297.290-297.311=-0.021
max297.329-297.337=-0.007
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean0.386-0.388=-0.002
σ0.002-0.004=-0.002
min0.384-0.385=-0.001
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1299.004-1299.018=-0.014
σ0.089-0.064=0.025
min1298.845-1298.929=-0.083
max1299.060-1299.072=-0.011
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean1.964-1.858=0.106
σ0.122-0.033=0.089
min1.851-1.822=0.029
max2.144-1.900=0.245
iters=5
new-facts=6402
prior-facts=1
mean1719.186-1719.172=0.015
σ6.945-6.945=-0.000
min1715.923-1715.893=0.031
max1731.605-1731.590=0.015
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean3.009-3.038=-0.029
σ0.463-0.490=-0.027
min2.569-2.498=0.070
max3.785-3.807=-0.022
iters=5
new-facts=6402
prior-facts=6402
mean1981.951-1981.921=0.030
σ0.010-0.036=-0.026
min1981.943-1981.858=0.085
max1981.966-1981.944=0.022
mean1875.600-1799.800=75.800
σ201.136-166.854=34.282
min1605.000-1632.000=-27.000
max2087.000-2034.000=53.000
mean3.209-3.316=-0.107
σ0.087-0.372=-0.285
min3.109-3.082=0.027
max3.303-3.971=-0.668

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.568-1.156=0.411
σ0.301-0.276=0.024
min1.170-0.904=0.266
max1.813-1.578=0.235

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.451-440.454=-0.003
σ573.026-573.036=-0.010
min153.930-153.926=0.004
max1299.990-1300.008=-0.018
mean94.250
σ8.500
min90.000
max107.000
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean0.538-0.516=0.022
σ0.539-0.521=0.018
min0.265-0.254=0.011
max1.346-1.297=0.049
policies=20
mean1539.584-1539.565=0.019
σ0.296-0.307=-0.011
min1539.388-1539.380=0.008
max1540.022-1540.023=-0.000
mean900.000
σ0.000
min900.000
max900.000
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean2.548-2.579=-0.031
σ0.006-0.022=-0.016
min2.540-2.546=-0.006
max2.553-2.594=-0.041
policies=200
mean15404.078-15403.653=0.425
σ0.106-0.147=-0.041
min15403.982-15403.541=0.442
max15404.219-15403.863=0.355
mean9000.000
σ0.000
min9000.000
max9000.000
mean1514.000-1632.000=-118.000
σ0.000
min1514.000-1632.000=-118.000
max1514.000-1632.000=-118.000
mean25.964-25.937=0.027
σ0.060-0.172=-0.111
min25.918-25.785=0.133
max26.046-26.099=-0.053