Compare commits

Home / Compare bb3c5a30 .. 85cdeef1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.656-53.654=0.002
σ0.368-0.370=-0.003
min53.515-53.509=0.005
max54.702-54.707=-0.005
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.136=0.004
σ0.003-0.005=-0.002
min0.137-0.131=0.006
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.006-0.005=0.001
min42.974-42.972=0.002
max42.992-42.986=0.006
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.121-0.122=-0.001
σ0.004-0.004=0.000
min0.118-0.119=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.691=0.280
σ1.164-1.237=-0.073
min1013.423-1013.087=0.335
max1018.839-1018.875=-0.037
mean1052.500-1058.900=-6.400
σ309.751-315.622=-5.870
min573.000-596.000=-23.000
max1653.000-1661.000=-8.000
mean1.620-1.610=0.010
σ0.098-0.075=0.023
min1.486-1.476=0.010
max1.899-1.842=0.057

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.197-334.412=-35.215
σ0.235-0.226=0.008
min298.964-334.244=-35.280
max299.802-335.028=-35.225
mean1964.000-2106.000=-142.000
σ0.000
min1964.000-2106.000=-142.000
max1964.000-2106.000=-142.000
mean0.581-0.749=-0.168
σ0.021-0.047=-0.027
min0.545-0.674=-0.129
max0.607-0.839=-0.232

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.411=0.267
σ0.013-0.013=0.000
min294.659-294.389=0.270
max294.695-294.423=0.272
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean0.379-0.382=-0.004
σ0.008-0.001=0.007
min0.364-0.380=-0.016
max0.384-0.384=0.001
iters=5
new-facts=1
prior-facts=6402
mean1316.927-1316.694=0.233
σ0.110-0.075=0.035
min1316.854-1316.566=0.288
max1317.121-1316.758=0.364
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean1.889-1.912=-0.023
σ0.061-0.074=-0.013
min1.838-1.843=-0.005
max1.985-2.030=-0.045
iters=5
new-facts=6402
prior-facts=1
mean1555.293-1736.955=-181.663
σ6.865-6.901=-0.036
min1551.985-1733.760=-181.775
max1567.567-1749.298=-181.731
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean2.277-2.927=-0.650
σ0.234-0.399=-0.165
min2.124-2.586=-0.463
max2.685-3.557=-0.872
iters=5
new-facts=6402
prior-facts=6402
mean1884.781-1999.654=-114.873
σ0.030-0.016=0.014
min1884.761-1999.632=-114.870
max1884.832-1999.671=-114.838
mean1767.600-1872.200=-104.600
σ127.845-185.937=-58.093
min1653.000-1661.000=-8.000
max1964.000-2106.000=-142.000
mean2.915-3.349=-0.434
σ0.234-0.142=0.092
min2.707-3.213=-0.506
max3.290-3.504=-0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.185=-0.012
σ0.309-0.410=-0.101
min0.912-0.912=-0.000
max1.688-1.881=-0.194

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.487-441.091=-0.604
σ573.035-573.033=0.002
min153.964-154.562=-0.598
max1300.040-1300.641=-0.601
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean0.543-0.553=-0.010
σ0.563-0.574=-0.011
min0.259-0.263=-0.004
max1.387-1.414=-0.027
policies=20
mean1539.846-1545.918=-6.072
σ0.307-0.343=-0.036
min1539.672-1545.715=-6.043
max1540.306-1546.432=-6.126
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean2.580-2.638=-0.058
σ0.009-0.017=-0.008
min2.570-2.615=-0.045
max2.591-2.654=-0.063
policies=200
mean15406.520-15466.945=-60.425
σ0.093-0.089=0.004
min15406.411-15466.824=-60.413
max15406.617-15467.012=-60.395
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1653.000-1661.000=-8.000
σ0.000
min1653.000-1661.000=-8.000
max1653.000-1661.000=-8.000
mean26.155-26.858=-0.703
σ0.152-0.214=-0.062
min26.005-26.671=-0.666
max26.333-27.094=-0.761