Compare commits

Home / Compare ec1b51b8 .. 319fb7b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.003
σ0.369-0.370=-0.001
min53.871-53.876=-0.004
max55.063-55.068=-0.005
mean415.000-419.900=-4.900
σ0.000-0.316=-0.316
min415.000-419.000=-4.000
max415.000-420.000=-5.000
mean0.137-0.141=-0.005
σ0.005-0.005=0.000
min0.130-0.137=-0.007
max0.143-0.149=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.007=0.000
min43.313-43.314=-0.001
max43.337-43.338=-0.001
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.120-0.122=-0.002
σ0.004-0.004=-0.000
min0.115-0.115=-0.000
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1011.001-1011.006=-0.005
σ1.165-1.146=0.019
min1010.434-1010.430=0.004
max1015.878-1015.790=0.088
mean1048.250-1052.700=-4.450
σ301.088-311.095=-10.008
min590.000-588.000=2.000
max1444.000-1654.000=-210.000
mean1.526-1.532=-0.006
σ0.062-0.068=-0.006
min1.429-1.448=-0.019
max1.671-1.643=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.032-300.993=0.039
σ0.242-0.198=0.044
min300.872-300.836=0.036
max301.695-301.537=0.157
mean1974.000-1940.000=34.000
σ0.000
min1974.000-1940.000=34.000
max1974.000-1940.000=34.000
mean0.536-0.574=-0.038
σ0.030-0.035=-0.005
min0.506-0.505=0.001
max0.582-0.601=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.453-299.439=0.014
σ0.041-0.058=-0.017
min299.394-299.346=0.048
max299.502-299.487=0.015
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean0.389-0.390=-0.001
σ0.007-0.006=0.001
min0.385-0.386=-0.001
max0.401-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1309.882-1309.872=0.011
σ0.086-0.085=0.001
min1309.771-1309.768=0.002
max1309.997-1309.994=0.003
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean1.902-1.890=0.012
σ0.084-0.107=-0.023
min1.804-1.755=0.049
max2.034-2.029=0.005
iters=5
new-facts=6402
prior-facts=1
mean1553.974-1553.987=-0.013
σ6.867-6.872=-0.005
min1550.673-1550.685=-0.012
max1566.252-1566.273=-0.021
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean2.306-2.361=-0.056
σ0.274-0.293=-0.019
min2.067-2.022=0.046
max2.603-2.701=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean1871.764-1871.760=0.003
σ0.050-0.047=0.004
min1871.697-1871.705=-0.008
max1871.807-1871.800=0.007
mean1731.000-1756.000=-25.000
σ173.931-117.115=56.816
min1521.000-1654.000=-133.000
max1974.000-1940.000=34.000
mean2.897-2.928=-0.032
σ0.060-0.096=-0.035
min2.831-2.821=0.011
max2.963-3.072=-0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.716-1.219=0.497
σ0.102-0.361=-0.258
min1.598-0.931=0.667
max1.878-1.828=0.050

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.789-447.804=-0.015
σ581.216-581.234=-0.017
min157.180-157.181=-0.001
max1319.614-1319.654=-0.041
mean96.250
σ8.500
min92.000
max109.000
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean0.531-0.543=-0.011
σ0.543-0.568=-0.025
min0.258-0.258=0.001
max1.346-1.395=-0.049
policies=20
mean1572.098-1572.098=0.000
σ0.343-0.332=0.011
min1571.873-1571.903=-0.030
max1572.610-1572.595=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean2.623-2.624=-0.001
σ0.014-0.012=0.002
min2.608-2.616=-0.007
max2.642-2.642=0.001
policies=200
mean15729.025-15728.921=0.104
σ0.160-0.111=0.049
min15728.851-15728.813=0.038
max15729.165-15729.046=0.119
mean9200.000
σ0.000
min9200.000
max9200.000
mean1444.000-1654.000=-210.000
σ0.000
min1444.000-1654.000=-210.000
max1444.000-1654.000=-210.000
mean26.575-26.603=-0.027
σ0.301-0.139=0.162
min26.232-26.455=-0.222
max26.927-26.738=0.188