Compare commits

Home / Compare 51bffdd3 .. 61d118b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.969-53.823=0.147
σ0.369-0.370=-0.001
min53.830-53.677=0.153
max55.020-54.876=0.144
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.135-0.138=-0.003
σ0.005-0.003=0.001
min0.129-0.135=-0.005
max0.143-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.208=0.134
σ0.006-0.007=-0.000
min43.330-43.199=0.132
max43.355-43.220=0.135
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.123-0.120=0.003
σ0.004-0.003=0.001
min0.120-0.117=0.003
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.893-1016.179=0.715
σ1.196-1.174=0.021
min1016.347-1015.604=0.743
max1021.911-1021.098=0.813
mean1060.300-1052.750=7.550
σ316.908-296.828=20.080
min554.000-581.000=-27.000
max1619.000-1449.000=170.000
mean1.531-1.521=0.010
σ0.106-0.067=0.039
min1.375-1.462=-0.087
max1.806-1.695=0.111

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.148-301.454=0.694
σ0.251-0.308=-0.057
min301.956-301.146=0.811
max302.828-302.200=0.628
mean2044.000-2043.000=1.000
σ0.000
min2044.000-2043.000=1.000
max2044.000-2043.000=1.000
mean0.588-0.571=0.016
σ0.031-0.026=0.006
min0.501-0.519=-0.017
max0.607-0.603=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.519-300.684=2.835
σ0.053-0.046=0.006
min303.442-300.603=2.839
max303.567-300.715=2.853
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean0.391-0.397=-0.006
σ0.002-0.007=-0.005
min0.389-0.389=0.000
max0.393-0.403=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1326.066-1322.879=3.187
σ0.111-0.097=0.014
min1325.926-1322.812=3.114
max1326.206-1323.044=3.161
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean1.909-1.847=0.062
σ0.102-0.036=0.067
min1.816-1.799=0.017
max2.070-1.895=0.175
iters=5
new-facts=6402
prior-facts=1
mean1564.109-1561.319=2.790
σ6.917-6.908=0.009
min1560.759-1558.014=2.745
max1576.476-1573.671=2.805
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean2.344-2.372=-0.028
σ0.280-0.401=-0.121
min2.115-1.995=0.119
max2.689-2.912=-0.223
iters=5
new-facts=6402
prior-facts=6402
mean1894.001-1890.793=3.207
σ0.062-0.025=0.038
min1893.892-1890.765=3.128
max1894.046-1890.826=3.220
mean1768.800-1730.600=38.200
σ177.856-237.525=-59.670
min1619.000-1449.000=170.000
max2044.000-2043.000=1.000
mean2.939-2.917=0.022
σ0.092-0.113=-0.022
min2.856-2.864=-0.008
max3.056-3.119=-0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.712=-0.508
σ0.264-0.101=0.163
min0.912-1.538=-0.626
max1.611-1.789=-0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.710-443.322=1.388
σ575.146-573.971=1.175
min157.125-156.329=0.796
max1307.430-1304.279=3.151
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean0.550-0.538=0.012
σ0.559-0.554=0.006
min0.268-0.260=0.008
max1.388-1.368=0.020
policies=20
mean1571.557-1563.616=7.941
σ0.331-0.340=-0.009
min1571.369-1563.397=7.972
max1572.054-1564.124=7.930
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean2.627-2.624=0.002
σ0.019-0.050=-0.032
min2.605-2.578=0.027
max2.645-2.696=-0.051
policies=200
mean15723.262-15644.036=79.226
σ0.123-0.100=0.022
min15723.126-15643.915=79.211
max15723.399-15644.124=79.275
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1449.000=170.000
σ0.000
min1619.000-1449.000=170.000
max1619.000-1449.000=170.000
mean26.495-26.394=0.102
σ0.156-0.130=0.027
min26.307-26.291=0.016
max26.624-26.564=0.060