Compare commits

Home / Compare 3c560588 .. dbc5a190

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.824-53.824=0.000
σ0.368-0.368=-0.000
min53.676-53.681=-0.005
max54.870-54.870=-0.000
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.136-0.139=-0.002
σ0.005-0.002=0.002
min0.130-0.136=-0.006
max0.144-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.001
σ0.007-0.006=0.001
min43.196-43.197=-0.001
max43.222-43.217=0.005
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.119-0.122=-0.003
σ0.004-0.005=-0.001
min0.114-0.115=-0.001
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.174=0.001
σ1.184-1.190=-0.006
min1015.627-1015.628=-0.001
max1021.137-1021.160=-0.023
mean1043.450-1049.800=-6.350
σ310.286-312.198=-1.912
min598.000-557.000=41.000
max1635.000-1516.000=119.000
mean1.569-1.555=0.015
σ0.066-0.057=0.008
min1.494-1.485=0.009
max1.725-1.664=0.061

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.253-301.196=0.058
σ0.219-0.242=-0.023
min301.064-301.086=-0.022
max301.836-301.880=-0.044
mean1957.000-2017.000=-60.000
σ0.000
min1957.000-2017.000=-60.000
max1957.000-2017.000=-60.000
mean0.576-0.558=0.018
σ0.027-0.031=-0.004
min0.513-0.501=0.012
max0.621-0.595=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.682-300.701=-0.019
σ0.051-0.021=0.029
min300.594-300.668=-0.074
max300.716-300.722=-0.006
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean0.404-0.400=0.004
σ0.014-0.007=0.007
min0.388-0.388=0.000
max0.421-0.407=0.014
iters=5
new-facts=1
prior-facts=6402
mean1322.882-1322.865=0.017
σ0.062-0.093=-0.031
min1322.809-1322.815=-0.007
max1322.957-1323.030=-0.073
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean2.099-1.963=0.136
σ0.189-0.131=0.058
min1.914-1.821=0.093
max2.384-2.116=0.269
iters=5
new-facts=6402
prior-facts=1
mean1561.378-1561.309=0.070
σ6.828-6.906=-0.077
min1558.173-1558.001=0.171
max1573.590-1573.657=-0.066
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean2.345-2.327=0.018
σ0.178-0.291=-0.114
min2.147-2.052=0.095
max2.582-2.749=-0.167
iters=5
new-facts=6402
prior-facts=6402
mean1890.801-1890.804=-0.003
σ0.019-0.044=-0.024
min1890.784-1890.764=0.019
max1890.832-1890.879=-0.047
mean1786.200-1728.000=58.200
σ119.001-204.967=-85.966
min1635.000-1516.000=119.000
max1957.000-2017.000=-60.000
mean2.982-3.053=-0.071
σ0.122-0.297=-0.175
min2.865-2.807=0.058
max3.172-3.528=-0.356

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.499=-0.296
σ0.292-0.314=-0.022
min0.907-1.088=-0.182
max1.678-1.732=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.335-443.329=0.006
σ573.990-573.983=0.007
min156.339-156.332=0.007
max1304.320-1304.303=0.017
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean0.538-0.521=0.017
σ0.553-0.521=0.032
min0.259-0.259=0.000
max1.367-1.302=0.065
policies=20
mean1563.639-1563.606=0.033
σ0.337-0.344=-0.007
min1563.451-1563.389=0.061
max1564.144-1564.120=0.024
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean2.625-2.624=0.001
σ0.007-0.007=0.000
min2.617-2.615=0.002
max2.633-2.629=0.004
policies=200
mean15644.170-15644.112=0.058
σ0.127-0.121=0.005
min15644.087-15643.952=0.135
max15644.358-15644.246=0.113
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1516.000=119.000
σ0.000
min1635.000-1516.000=119.000
max1635.000-1516.000=119.000
mean26.527-26.482=0.045
σ0.125-0.101=0.025
min26.385-26.335=0.050
max26.673-26.554=0.120