Compare commits

Home / Compare 19ccee8a .. 5101a3f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.834=0.001
σ0.366-0.368=-0.001
min53.690-53.690=0.000
max54.878-54.880=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.138-0.134=0.004
σ0.005-0.004=0.001
min0.130-0.129=0.002
max0.148-0.140=0.008
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.001
σ0.005-0.006=-0.001
min43.202-43.200=0.002
max43.220-43.218=0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.121=-0.001
σ0.004-0.005=-0.001
min0.114-0.113=0.000
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.204=0.003
σ1.161-1.175=-0.014
min1015.633-1015.637=-0.004
max1021.064-1021.126=-0.061
mean1041.150-1049.000=-7.850
σ310.695-311.302=-0.607
min576.000-557.000=19.000
max1628.000-1513.000=115.000
mean1.536-1.522=0.014
σ0.098-0.059=0.040
min1.456-1.461=-0.004
max1.790-1.666=0.124

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.210-301.433=-0.223
σ0.259-0.188=0.071
min301.085-301.296=-0.211
max301.943-301.947=-0.004
mean2019.000-2013.000=6.000
σ0.000
min2019.000-2013.000=6.000
max2019.000-2013.000=6.000
mean0.561-0.567=-0.006
σ0.042-0.034=0.009
min0.500-0.510=-0.010
max0.609-0.602=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.465-301.482=-0.017
σ0.074-0.045=0.029
min301.344-301.413=-0.069
max301.530-301.531=-0.001
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean0.391-0.394=-0.002
σ0.001-0.004=-0.003
min0.389-0.390=-0.000
max0.393-0.400=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1324.066-1324.057=0.009
σ0.115-0.105=0.010
min1323.927-1323.927=0.000
max1324.205-1324.186=0.019
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean1.890-1.855=0.035
σ0.056-0.047=0.009
min1.833-1.804=0.029
max1.956-1.920=0.036
iters=5
new-facts=6402
prior-facts=1
mean1562.071-1562.116=-0.045
σ6.942-6.913=0.029
min1558.770-1558.808=-0.038
max1574.483-1574.477=0.006
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean2.318-2.429=-0.111
σ0.384-0.343=0.041
min1.914-2.033=-0.119
max2.875-2.808=0.067
iters=5
new-facts=6402
prior-facts=6402
mean1891.969-1891.976=-0.007
σ0.067-0.071=-0.004
min1891.853-1891.849=0.004
max1892.018-1892.012=0.006
mean1763.600-1724.400=39.200
σ164.044-209.697=-45.653
min1628.000-1513.000=115.000
max2019.000-2013.000=6.000
mean3.008-2.970=0.037
σ0.262-0.273=-0.011
min2.700-2.739=-0.039
max3.378-3.444=-0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.147-1.540=-0.393
σ0.310-0.314=-0.004
min0.899-1.148=-0.248
max1.646-1.795=-0.149

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.488-443.485=0.004
σ574.243-574.234=0.009
min156.360-156.362=-0.002
max1304.853-1304.835=0.017
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean0.544-0.552=-0.008
σ0.561-0.569=-0.008
min0.260-0.264=-0.003
max1.386-1.405=-0.020
policies=20
mean1563.924-1563.906=0.017
σ0.328-0.337=-0.009
min1563.742-1563.693=0.049
max1564.416-1564.410=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean2.623-2.617=0.006
σ0.006-0.014=-0.007
min2.615-2.601=0.014
max2.630-2.629=0.000
policies=200
mean15647.002-15646.922=0.080
σ0.063-0.174=-0.110
min15646.912-15646.795=0.116
max15647.057-15647.172=-0.115
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1513.000=115.000
σ0.000
min1628.000-1513.000=115.000
max1628.000-1513.000=115.000
mean26.469-26.451=0.018
σ0.154-0.109=0.045
min26.288-26.338=-0.050
max26.623-26.562=0.061