Compare commits

Home / Compare 52b25772 .. dc62115d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.038-54.039=-0.001
σ0.368-0.370=-0.002
min53.902-53.896=0.006
max55.085-55.092=-0.007
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.002
min0.132-0.136=-0.004
max0.149-0.146=0.004
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.007-0.007=0.000
min43.333-43.331=0.002
max43.358-43.355=0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.120-0.119=0.000
σ0.004-0.003=0.001
min0.115-0.114=0.001
max0.129-0.122=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.204-1017.203=0.002
σ1.165-1.170=-0.004
min1016.628-1016.625=0.003
max1022.086-1022.100=-0.013
mean1052.850-1060.250=-7.400
σ318.942-316.531=2.411
min578.000-556.000=22.000
max1620.000-1518.000=102.000
mean1.553-1.543=0.010
σ0.086-0.060=0.026
min1.418-1.460=-0.043
max1.762-1.648=0.115

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.962-301.877=0.085
σ0.251-0.249=0.003
min301.807-301.757=0.050
max302.652-302.576=0.076
mean2044.000-1943.000=101.000
σ0.000
min2044.000-1943.000=101.000
max2044.000-1943.000=101.000
mean0.595-0.617=-0.022
σ0.034-0.023=0.011
min0.501-0.602=-0.101
max0.613-0.680=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.780-303.787=-0.007
σ0.076-0.051=0.026
min303.648-303.720=-0.072
max303.840-303.845=-0.004
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean0.399-0.391=0.008
σ0.007-0.001=0.007
min0.392-0.390=0.002
max0.410-0.392=0.018
iters=5
new-facts=1
prior-facts=6402
mean1326.338-1326.323=0.014
σ0.106-0.099=0.007
min1326.204-1326.193=0.011
max1326.462-1326.451=0.011
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean1.885-1.929=-0.044
σ0.082-0.078=0.004
min1.769-1.851=-0.082
max1.965-2.034=-0.069
iters=5
new-facts=6402
prior-facts=1
mean1564.391-1564.435=-0.044
σ6.931-6.871=0.060
min1561.103-1561.187=-0.084
max1576.785-1576.722=0.063
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean2.324-2.381=-0.056
σ0.294-0.219=0.075
min2.060-2.085=-0.024
max2.664-2.613=0.052
iters=5
new-facts=6402
prior-facts=6402
mean1894.279-1894.280=-0.001
σ0.076-0.069=0.007
min1894.144-1894.158=-0.014
max1894.323-1894.321=0.002
mean1770.000-1753.800=16.200
σ179.308-191.900=-12.592
min1620.000-1518.000=102.000
max2044.000-1943.000=101.000
mean2.916-3.053=-0.137
σ0.129-0.122=0.007
min2.789-2.890=-0.102
max3.133-3.219=-0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.253-1.624=-0.371
σ0.316-0.322=-0.006
min0.941-1.266=-0.325
max1.650-1.933=-0.283

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.060-448.048=0.012
σ581.237-581.228=0.009
min157.435-157.429=0.006
max1319.914-1319.889=0.025
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean0.554-0.543=0.011
σ0.573-0.558=0.015
min0.266-0.263=0.002
max1.413-1.380=0.034
policies=20
mean1574.632-1574.612=0.020
σ0.351-0.347=0.004
min1574.415-1574.396=0.019
max1575.156-1575.129=0.027
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean2.655-2.645=0.011
σ0.019-0.009=0.009
min2.638-2.631=0.007
max2.681-2.653=0.027
policies=200
mean15754.319-15754.288=0.031
σ0.103-0.096=0.007
min15754.169-15754.188=-0.018
max15754.403-15754.388=0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1518.000=102.000
σ0.000
min1620.000-1518.000=102.000
max1620.000-1518.000=102.000
mean26.941-26.790=0.150
σ0.357-0.167=0.190
min26.693-26.582=0.111
max27.451-26.945=0.506