Compare commits

Home / Compare 85bc16e2 .. 12a496ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.706=0.003
σ0.362-0.365=-0.002
min53.573-53.569=0.005
max54.739-54.743=-0.004
mean413.800-416.100=-2.300
σ0.422-0.316=0.105
min413.000-416.000=-3.000
max414.000-417.000=-3.000
mean0.137-0.139=-0.002
σ0.004-0.004=-0.000
min0.131-0.134=-0.003
max0.144-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.977=0.002
σ0.005-0.006=-0.001
min42.972-42.964=0.008
max42.988-42.985=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.119=0.002
σ0.005-0.005=-0.000
min0.113-0.112=0.001
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.223-994.903=0.320
σ1.174-1.198=-0.024
min994.690-994.373=0.318
max1000.149-999.927=0.223
mean1056.150-1058.850=-2.700
σ311.901-312.110=-0.210
min593.000-599.000=-6.000
max1513.000-1601.000=-88.000
mean1.503-1.453=0.050
σ0.163-0.079=0.085
min1.340-1.388=-0.048
max2.118-1.694=0.424

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.318-297.316=0.002
σ0.004-0.012=-0.008
min297.312-297.298=0.014
max297.323-297.331=-0.009
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean0.386-0.389=-0.003
σ0.002-0.002=-0.000
min0.384-0.387=-0.004
max0.389-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1298.999-1298.674=0.326
σ0.094-0.100=-0.005
min1298.842-1298.509=0.333
max1299.084-1298.758=0.325
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean2.029-1.986=0.044
σ0.262-0.166=0.096
min1.842-1.839=0.003
max2.488-2.257=0.231
iters=5
new-facts=6402
prior-facts=1
mean1719.186-1718.881=0.305
σ6.929-6.901=0.028
min1715.999-1715.691=0.307
max1731.578-1731.223=0.354
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean2.963-2.912=0.051
σ0.463-0.313=0.150
min2.520-2.623=-0.104
max3.749-3.447=0.302
iters=5
new-facts=6402
prior-facts=6402
mean1981.946-1981.611=0.335
σ0.005-0.009=-0.003
min1981.940-1981.604=0.336
max1981.952-1981.625=0.327
mean1780.000-1782.200=-2.200
σ200.407-175.706=24.701
min1513.000-1601.000=-88.000
max1963.000-1967.000=-4.000
mean3.138-3.126=0.011
σ0.112-0.050=0.061
min2.958-3.083=-0.125
max3.251-3.213=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.526-1.300=0.227
σ0.271-0.423=-0.151
min1.188-0.934=0.253
max1.782-1.788=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.450-440.376=0.074
σ573.028-572.880=0.148
min153.932-153.924=0.008
max1299.992-1299.695=0.297
mean94.250
σ8.500
min90.000
max107.000
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean0.535-0.529=0.006
σ0.534-0.547=-0.013
min0.265-0.255=0.010
max1.336-1.350=-0.014
policies=20
mean1539.589-1539.547=0.042
σ0.299-0.356=-0.056
min1539.389-1539.332=0.057
max1540.034-1540.077=-0.043
mean900.000
σ0.000
min900.000
max900.000
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean2.562-2.645=-0.083
σ0.010-0.058=-0.048
min2.552-2.602=-0.050
max2.572-2.729=-0.157
policies=200
mean15404.005-15403.437=0.568
σ0.260-0.137=0.123
min15403.619-15403.317=0.302
max15404.186-15403.564=0.622
mean9000.000
σ0.000
min9000.000
max9000.000
mean1513.000-1601.000=-88.000
σ0.000
min1513.000-1601.000=-88.000
max1513.000-1601.000=-88.000
mean25.930-25.995=-0.065
σ0.107-0.116=-0.010
min25.831-25.891=-0.060
max26.034-26.104=-0.070