Compare commits

Home / Compare cdc0f1d3 .. 8b6c88f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.969-53.971=-0.002
σ0.369-0.368=0.002
min53.830-53.823=0.007
max55.020-55.017=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.135-0.139=-0.004
σ0.005-0.003=0.001
min0.129-0.135=-0.006
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.006-0.007=-0.001
min43.330-43.331=-0.001
max43.355-43.356=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.122=0.001
σ0.004-0.005=-0.002
min0.120-0.116=0.004
max0.129-0.131=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.893-1016.896=-0.003
σ1.196-1.162=0.033
min1016.347-1016.322=0.025
max1021.911-1021.762=0.149
mean1060.300-1061.600=-1.300
σ316.908-312.597=4.311
min554.000-589.000=-35.000
max1619.000-1637.000=-18.000
mean1.531-1.523=0.008
σ0.106-0.089=0.017
min1.375-1.435=-0.060
max1.806-1.791=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.148-302.009=0.139
σ0.251-0.202=0.049
min301.956-301.828=0.129
max302.828-302.524=0.305
mean2044.000-2043.000=1.000
σ0.000
min2044.000-2043.000=1.000
max2044.000-2043.000=1.000
mean0.588-0.592=-0.004
σ0.031-0.031=0.000
min0.501-0.519=-0.018
max0.607-0.613=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.519-303.499=0.020
σ0.053-0.081=-0.028
min303.442-303.366=0.076
max303.567-303.572=-0.004
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean0.391-0.390=0.001
σ0.002-0.006=-0.004
min0.389-0.386=0.003
max0.393-0.401=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1326.066-1326.061=0.005
σ0.111-0.108=0.004
min1325.926-1325.925=0.001
max1326.206-1326.194=0.012
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean1.909-1.893=0.016
σ0.102-0.067=0.035
min1.816-1.832=-0.015
max2.070-1.982=0.088
iters=5
new-facts=6402
prior-facts=1
mean1564.109-1564.189=-0.080
σ6.917-6.873=0.045
min1560.759-1560.908=-0.149
max1576.476-1576.479=-0.003
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean2.344-2.479=-0.135
σ0.280-0.267=0.013
min2.115-2.025=0.089
max2.689-2.737=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean1894.001-1894.004=-0.004
σ0.062-0.065=-0.003
min1893.892-1893.889=0.003
max1894.046-1894.045=0.001
mean1768.800-1775.400=-6.600
σ177.856-169.985=7.871
min1619.000-1637.000=-18.000
max2044.000-2043.000=1.000
mean2.939-2.947=-0.008
σ0.092-0.148=-0.056
min2.856-2.847=0.009
max3.056-3.207=-0.151

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.188=0.015
σ0.264-0.279=-0.015
min0.912-0.911=0.001
max1.611-1.610=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.710-444.704=0.006
σ575.146-575.150=-0.003
min157.125-157.124=0.001
max1307.430-1307.429=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean0.550-0.526=0.024
σ0.559-0.532=0.027
min0.268-0.256=0.012
max1.388-1.324=0.064
policies=20
mean1571.557-1571.540=0.017
σ0.331-0.324=0.007
min1571.369-1571.363=0.005
max1572.054-1572.026=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean2.627-2.612=0.014
σ0.019-0.001=0.018
min2.605-2.611=-0.006
max2.645-2.614=0.031
policies=200
mean15723.262-15723.294=-0.032
σ0.123-0.118=0.005
min15723.126-15723.143=-0.017
max15723.399-15723.413=-0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1637.000=-18.000
σ0.000
min1619.000-1637.000=-18.000
max1619.000-1637.000=-18.000
mean26.495-26.518=-0.023
σ0.156-0.151=0.005
min26.307-26.382=-0.075
max26.624-26.658=-0.034