Compare commits

Home / Compare 1029d752 .. e7c67e3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-53.973=0.075
σ0.368-0.370=-0.002
min53.903-53.826=0.077
max55.095-55.025=0.070
mean418.000-422.000=-4.000
σ0.000
min418.000-422.000=-4.000
max418.000-422.000=-4.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.001
min0.132-0.136=-0.004
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.341-43.342=-0.001
σ0.005-0.004=0.001
min43.333-43.336=-0.003
max43.351-43.349=0.001
mean418.000-422.000=-4.000
σ0.000
min418.000-422.000=-4.000
max418.000-422.000=-4.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.200-1016.898=0.302
σ1.156-1.149=0.008
min1016.627-1016.322=0.305
max1022.041-1021.699=0.342
mean1063.350-1064.250=-0.900
σ312.940-312.891=0.049
min593.000-594.000=-1.000
max1633.000-1632.000=1.000
mean1.511-1.526=-0.014
σ0.067-0.043=0.025
min1.313-1.459=-0.146
max1.629-1.610=0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.074-302.050=0.024
σ0.209-0.203=0.006
min301.945-301.936=0.009
max302.657-302.605=0.052
mean1949.000-2033.000=-84.000
σ0.000
min1949.000-2033.000=-84.000
max1949.000-2033.000=-84.000
mean0.558-0.588=-0.030
σ0.042-0.031=0.011
min0.499-0.511=-0.012
max0.596-0.609=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.801-303.523=0.278
σ0.034-0.034=0.000
min303.762-303.486=0.276
max303.842-303.570=0.271
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean0.390-0.390=0.001
σ0.002-0.001=0.001
min0.389-0.389=-0.000
max0.393-0.390=0.003
iters=5
new-facts=1
prior-facts=6402
mean1326.326-1326.059=0.267
σ0.098-0.105=-0.006
min1326.191-1325.929=0.261
max1326.442-1326.192=0.250
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean2.037-1.908=0.129
σ0.159-0.069=0.089
min1.878-1.839=0.039
max2.264-1.994=0.270
iters=5
new-facts=6402
prior-facts=1
mean1564.413-1564.123=0.290
σ6.921-6.920=0.001
min1561.088-1560.830=0.259
max1576.788-1576.498=0.290
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean2.420-2.350=0.069
σ0.284-0.333=-0.049
min2.161-2.017=0.144
max2.887-2.795=0.092
iters=5
new-facts=6402
prior-facts=6402
mean1894.289-1894.003=0.286
σ0.090-0.065=0.025
min1894.132-1893.890=0.241
max1894.356-1894.049=0.307
mean1780.000-1769.800=10.200
σ114.164-167.728=-53.564
min1633.000-1632.000=1.000
max1949.000-2033.000=-84.000
mean2.958-2.976=-0.018
σ0.161-0.176=-0.015
min2.819-2.793=0.026
max3.216-3.215=0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.224=-0.031
σ0.281-0.360=-0.079
min0.947-0.918=0.029
max1.630-1.837=-0.207

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.177-444.706=3.471
σ581.476-575.144=6.332
min157.434-157.125=0.309
max1320.391-1307.422=12.969
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean0.552-0.559=-0.008
σ0.571-0.586=-0.014
min0.263-0.263=0.001
max1.409-1.438=-0.029
policies=20
mean1574.630-1571.551=3.079
σ0.338-0.347=-0.008
min1574.442-1571.352=3.090
max1575.138-1572.070=3.067
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean2.634-2.639=-0.005
σ0.011-0.015=-0.003
min2.623-2.623=-0.000
max2.649-2.657=-0.009
policies=200
mean15754.171-15723.258=30.913
σ0.050-0.069=-0.018
min15754.098-15723.194=30.904
max15754.212-15723.351=30.861
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1632.000=1.000
σ0.000
min1633.000-1632.000=1.000
max1633.000-1632.000=1.000
mean26.619-26.608=0.011
σ0.146-0.118=0.028
min26.501-26.439=0.062
max26.801-26.699=0.102