Compare commits

Home / Compare 170de118 .. 57e62350

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.048-54.047=0.001
σ0.368-0.368=0.000
min53.909-53.903=0.006
max55.096-55.095=0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.138=-0.000
σ0.005-0.004=0.001
min0.130-0.132=-0.002
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.341=0.001
σ0.008-0.005=0.002
min43.335-43.333=0.002
max43.362-43.351=0.011
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.122-0.120=0.001
σ0.004-0.004=0.000
min0.115-0.114=0.002
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1017.200=-0.004
σ1.190-1.156=0.034
min1016.653-1016.627=0.026
max1022.186-1022.041=0.144
mean1050.050-1063.350=-13.300
σ303.485-312.940=-9.454
min592.000-593.000=-1.000
max1637.000-1633.000=4.000
mean1.549-1.511=0.037
σ0.083-0.067=0.016
min1.433-1.313=0.120
max1.782-1.629=0.153

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.967-302.074=-0.107
σ0.261-0.209=0.052
min301.722-301.945=-0.223
max302.667-302.657=0.009
mean2060.000-1949.000=111.000
σ0.000
min2060.000-1949.000=111.000
max2060.000-1949.000=111.000
mean0.561-0.558=0.004
σ0.035-0.042=-0.007
min0.509-0.499=0.010
max0.599-0.596=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.781-303.801=-0.020
σ0.062-0.034=0.028
min303.682-303.762=-0.079
max303.841-303.842=-0.001
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean0.394-0.390=0.003
σ0.008-0.002=0.006
min0.389-0.389=0.000
max0.408-0.393=0.015
iters=5
new-facts=1
prior-facts=6402
mean1326.329-1326.326=0.003
σ0.105-0.098=0.006
min1326.192-1326.191=0.001
max1326.447-1326.442=0.004
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean1.933-2.037=-0.104
σ0.102-0.159=-0.056
min1.823-1.878=-0.056
max2.047-2.264=-0.218
iters=5
new-facts=6402
prior-facts=1
mean1564.409-1564.413=-0.004
σ6.864-6.921=-0.056
min1561.150-1561.088=0.062
max1576.685-1576.788=-0.103
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean2.331-2.420=-0.088
σ0.248-0.284=-0.036
min2.056-2.161=-0.105
max2.706-2.887=-0.181
iters=5
new-facts=6402
prior-facts=6402
mean1894.282-1894.289=-0.007
σ0.071-0.090=-0.019
min1894.159-1894.132=0.028
max1894.332-1894.356=-0.024
mean1803.000-1780.000=23.000
σ184.172-114.164=70.008
min1637.000-1633.000=4.000
max2060.000-1949.000=111.000
mean3.058-2.958=0.100
σ0.122-0.161=-0.039
min2.911-2.819=0.092
max3.211-3.216=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.193=0.042
σ0.302-0.281=0.021
min0.939-0.947=-0.008
max1.577-1.630=-0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.337-448.177=0.160
σ581.794-581.476=0.318
min157.432-157.434=-0.002
max1321.029-1320.391=0.638
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean0.522-0.552=-0.030
σ0.517-0.571=-0.054
min0.259-0.263=-0.004
max1.298-1.409=-0.111
policies=20
mean1574.587-1574.630=-0.044
σ0.327-0.338=-0.012
min1574.388-1574.442=-0.054
max1575.076-1575.138=-0.062
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean2.614-2.634=-0.021
σ0.026-0.011=0.015
min2.589-2.623=-0.034
max2.642-2.649=-0.007
policies=200
mean15754.121-15754.171=-0.050
σ0.105-0.050=0.055
min15753.974-15754.098=-0.124
max15754.219-15754.212=0.007
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1633.000=4.000
σ0.000
min1637.000-1633.000=4.000
max1637.000-1633.000=4.000
mean26.499-26.619=-0.120
σ0.108-0.146=-0.037
min26.395-26.501=-0.105
max26.598-26.801=-0.204