Compare commits

Home / Compare 762a28d9 .. 2fde0fbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.970-53.971=-0.001
σ0.370-0.367=0.003
min53.827-53.829=-0.003
max55.023-55.016=0.007
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.135-0.139=-0.004
σ0.006-0.004=0.002
min0.129-0.136=-0.007
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.341=0.001
σ0.005-0.005=0.000
min43.335-43.334=0.000
max43.351-43.351=-0.000
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.121-0.123=-0.002
σ0.004-0.004=0.000
min0.116-0.119=-0.003
max0.129-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.899-1016.898=0.001
σ1.153-1.152=0.001
min1016.318-1016.322=-0.004
max1021.721-1021.716=0.005
mean1053.250-1061.850=-8.600
σ309.875-317.170=-7.295
min588.000-603.000=-15.000
max1628.000-1627.000=1.000
mean1.511-1.515=-0.004
σ0.054-0.090=-0.036
min1.445-1.411=0.035
max1.644-1.802=-0.158

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.051-302.049=0.002
σ0.294-0.190=0.104
min301.791-301.915=-0.124
max302.820-302.571=0.250
mean2020.000-2034.000=-14.000
σ0.000
min2020.000-2034.000=-14.000
max2020.000-2034.000=-14.000
mean0.584-0.590=-0.006
σ0.032-0.031=0.001
min0.510-0.503=0.007
max0.607-0.606=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.520-303.518=0.001
σ0.048-0.051=-0.003
min303.447-303.445=0.002
max303.572-303.568=0.004
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean0.390-0.391=-0.000
σ0.003-0.002=0.001
min0.388-0.388=-0.001
max0.395-0.394=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.068-1326.063=0.005
σ0.117-0.106=0.011
min1325.927-1325.928=-0.001
max1326.211-1326.178=0.033
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean1.908-1.872=0.036
σ0.075-0.071=0.005
min1.830-1.774=0.056
max2.005-1.963=0.042
iters=5
new-facts=6402
prior-facts=1
mean1564.104-1564.163=-0.058
σ6.922-6.900=0.023
min1560.791-1560.840=-0.050
max1576.482-1576.501=-0.019
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean2.263-2.466=-0.203
σ0.261-0.343=-0.083
min2.057-2.080=-0.023
max2.712-2.754=-0.042
iters=5
new-facts=6402
prior-facts=6402
mean1894.005-1894.004=0.001
σ0.067-0.065=0.002
min1893.890-1893.890=0.001
max1894.060-1894.046=0.014
mean1762.600-1770.400=-7.800
σ164.057-174.523=-10.466
min1628.000-1627.000=1.000
max2020.000-2034.000=-14.000
mean2.986-2.903=0.083
σ0.259-0.073=0.186
min2.709-2.845=-0.137
max3.403-3.029=0.374

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.286=-0.060
σ0.371-0.358=0.013
min0.899-0.914=-0.016
max1.802-1.794=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.705-444.707=-0.002
σ575.145-575.146=-0.000
min157.123-157.126=-0.003
max1307.423-1307.425=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean0.537-0.534=0.003
σ0.553-0.545=0.008
min0.259-0.259=0.000
max1.366-1.352=0.015
policies=20
mean1571.536-1571.541=-0.005
σ0.327-0.329=-0.001
min1571.349-1571.350=-0.001
max1572.027-1572.033=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean2.617-2.601=0.016
σ0.015-0.011=0.004
min2.600-2.589=0.011
max2.633-2.614=0.019
policies=200
mean15723.254-15723.354=-0.100
σ0.165-0.111=0.054
min15723.095-15723.195=-0.100
max15723.465-15723.441=0.024
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1627.000=1.000
σ0.000
min1628.000-1627.000=1.000
max1628.000-1627.000=1.000
mean26.521-26.515=0.006
σ0.202-0.251=-0.049
min26.312-26.295=0.017
max26.720-26.842=-0.122