Compare commits

Home / Compare 7faf2e6a .. 1d628b04

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1449.376-1449.378=-0.002
σ0.405-0.406=-0.001
min1449.203-1449.211=-0.008
max1450.512-1450.520=-0.008
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean2.261-2.254=0.007
σ0.016-0.021=-0.004
min2.231-2.221=0.010
max2.282-2.278=0.003
cache=y
dps=1
iters=10
policies=100
mean1438.539-1438.545=-0.006
σ0.015-0.018=-0.004
min1438.518-1438.510=0.008
max1438.564-1438.565=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean2.243-2.279=-0.036
σ0.021-0.052=-0.031
min2.212-2.206=0.006
max2.268-2.354=-0.086

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1031.996-1032.000=-0.004
σ1.126-1.112=0.014
min1031.450-1031.483=-0.033
max1036.719-1036.666=0.054
mean1056.550-1060.500=-3.950
σ323.259-309.833=13.426
min557.000-617.000=-60.000
max1628.000-1623.000=5.000
mean1.599-1.551=0.048
σ0.150-0.090=0.060
min1.494-1.396=0.098
max2.087-1.755=0.332

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean399.323-399.365=-0.042
σ0.075-0.081=-0.007
min399.226-399.227=-0.001
max399.379-399.418=-0.039
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean0.499-0.502=-0.004
σ0.008-0.012=-0.004
min0.493-0.489=0.003
max0.511-0.516=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1400.875-1400.832=0.042
σ0.045-0.008=0.038
min1400.837-1400.822=0.015
max1400.935-1400.840=0.095
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean2.192-1.985=0.207
σ0.271-0.057=0.214
min1.993-1.917=0.076
max2.574-2.039=0.536
iters=5
new-facts=6402
prior-facts=1
mean1923.080-1923.099=-0.019
σ7.088-7.048=0.039
min1919.820-1919.827=-0.007
max1935.756-1935.703=0.054
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean4.372-4.355=0.017
σ0.434-0.109=0.325
min4.003-4.209=-0.207
max5.103-4.473=0.630
iters=5
new-facts=6402
prior-facts=6402
mean2185.769-2185.756=0.013
σ0.057-0.015=0.041
min2185.694-2185.743=-0.049
max2185.838-2185.782=0.055
mean1796.400-1827.600=-31.200
σ170.594-170.923=-0.329
min1628.000-1623.000=5.000
max2041.000-2064.000=-23.000
mean4.728-4.692=0.036
σ0.268-0.060=0.208
min4.553-4.612=-0.059
max5.203-4.761=0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.179=0.047
σ0.231-0.357=-0.126
min1.040-0.909=0.132
max1.623-1.776=-0.153

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean458.938-458.942=-0.003
σ572.883-572.889=-0.006
min172.494-172.490=0.005
max1318.263-1318.276=-0.012
mean98.250
σ8.500
min94.000
max111.000
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean0.574-0.584=-0.010
σ0.557-0.594=-0.037
min0.287-0.285=0.002
max1.409-1.475=-0.065
policies=20
mean1725.173-1725.194=-0.022
σ0.413-0.405=0.008
min1724.864-1724.905=-0.041
max1725.773-1725.785=-0.012
mean940.000
σ0.000
min940.000
max940.000
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean2.851-2.834=0.017
σ0.034-0.008=0.026
min2.819-2.825=-0.006
max2.898-2.845=0.053
policies=200
mean17259.569-17259.558=0.011
σ0.126-0.157=-0.032
min17259.428-17259.404=0.024
max17259.733-17259.778=-0.045
mean9400.000
σ0.000
min9400.000
max9400.000
mean1628.000-1623.000=5.000
σ0.000
min1628.000-1623.000=5.000
max1628.000-1623.000=5.000
mean28.703-28.655=0.049
σ0.182-0.182=-0.000
min28.515-28.478=0.037
max28.924-28.833=0.091