Compare commits

Home / Compare b3378e4b .. a7433f3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.835=0.002
σ0.368-0.365=0.003
min53.687-53.695=-0.009
max54.884-54.874=0.011
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.140=-0.001
σ0.004-0.005=-0.001
min0.136-0.135=0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.001
σ0.004-0.006=-0.002
min43.201-43.199=0.003
max43.215-43.217=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.119-0.122=-0.003
σ0.004-0.003=0.000
min0.114-0.119=-0.005
max0.124-0.129=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.201=0.004
σ1.156-1.180=-0.024
min1015.631-1015.634=-0.003
max1021.040-1021.148=-0.108
mean1044.300-1049.100=-4.800
σ310.743-312.161=-1.418
min590.000-563.000=27.000
max1631.000-1517.000=114.000
mean1.533-1.523=0.010
σ0.079-0.053=0.026
min1.462-1.465=-0.003
max1.762-1.632=0.130

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.485-301.403=0.082
σ0.209-0.207=0.003
min301.345-301.260=0.085
max302.056-301.975=0.081
mean1954.000-2034.000=-80.000
σ0.000
min1954.000-2034.000=-80.000
max1954.000-2034.000=-80.000
mean0.557-0.569=-0.012
σ0.039-0.027=0.012
min0.509-0.523=-0.014
max0.605-0.604=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.485-301.477=0.008
σ0.048-0.047=0.001
min301.412-301.406=0.005
max301.538-301.528=0.010
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean0.392-0.396=-0.004
σ0.004-0.006=-0.002
min0.389-0.389=0.000
max0.399-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1324.049-1324.047=0.002
σ0.106-0.100=0.006
min1323.916-1323.927=-0.011
max1324.204-1324.187=0.017
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean1.964-1.888=0.076
σ0.134-0.054=0.080
min1.824-1.839=-0.015
max2.185-1.951=0.233
iters=5
new-facts=6402
prior-facts=1
mean1562.099-1562.083=0.016
σ6.957-6.905=0.053
min1558.752-1558.756=-0.004
max1574.539-1574.429=0.110
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean2.454-2.340=0.113
σ0.431-0.212=0.219
min2.051-2.092=-0.042
max3.130-2.611=0.519
iters=5
new-facts=6402
prior-facts=6402
mean1891.989-1891.972=0.017
σ0.090-0.068=0.021
min1891.835-1891.851=-0.016
max1892.068-1892.008=0.060
mean1784.400-1717.800=66.600
σ119.119-212.494=-93.375
min1631.000-1517.000=114.000
max1954.000-2034.000=-80.000
mean3.025-2.940=0.085
σ0.171-0.045=0.125
min2.899-2.904=-0.006
max3.318-3.015=0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.546=-0.373
σ0.300-0.323=-0.023
min0.905-1.161=-0.256
max1.638-1.814=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.488-443.485=0.003
σ574.247-574.236=0.011
min156.362-156.363=-0.001
max1304.858-1304.839=0.019
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean0.542-0.532=0.010
σ0.554-0.541=0.013
min0.260-0.261=-0.000
max1.373-1.344=0.029
policies=20
mean1563.926-1563.908=0.018
σ0.325-0.335=-0.010
min1563.754-1563.699=0.055
max1564.414-1564.408=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean2.618-2.622=-0.004
σ0.007-0.012=-0.004
min2.609-2.614=-0.005
max2.625-2.639=-0.014
policies=200
mean15646.920-15646.921=-0.001
σ0.118-0.047=0.070
min15646.800-15646.862=-0.062
max15647.063-15646.975=0.088
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean26.414-26.424=-0.011
σ0.142-0.082=0.060
min26.278-26.319=-0.041
max26.546-26.519=0.026