Compare commits

Home / Compare 9153ef3a .. 49803dd1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.836=0.001
σ0.369-0.366=0.003
min53.697-53.689=0.008
max54.887-54.877=0.011
mean417.000-414.700=2.300
σ0.000-0.483=-0.483
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.137-0.134=0.002
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-43.209=-0.002
σ0.007-0.005=0.002
min43.192-43.203=-0.010
max43.219-43.216=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.118=0.003
σ0.004-0.004=-0.001
min0.114-0.113=0.001
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.203=0.001
σ1.200-1.193=0.007
min1015.660-1015.660=-0.000
max1021.242-1021.203=0.039
mean1049.600-1054.500=-4.900
σ313.675-316.951=-3.276
min548.000-547.000=1.000
max1661.000-1629.000=32.000
mean1.570-1.561=0.008
σ0.103-0.101=0.002
min1.469-1.454=0.015
max1.846-1.809=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.168-301.225=-0.057
σ0.266-0.182=0.085
min300.985-301.071=-0.086
max301.891-301.719=0.172
mean2036.000-2035.000=1.000
σ0.000
min2036.000-2035.000=1.000
max2036.000-2035.000=1.000
mean0.560-0.550=0.010
σ0.028-0.032=-0.004
min0.503-0.514=-0.010
max0.584-0.601=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.480-301.475=0.005
σ0.050-0.059=-0.009
min301.410-301.382=0.029
max301.534-301.527=0.008
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean0.390-0.395=-0.006
σ0.001-0.008=-0.007
min0.389-0.390=-0.001
max0.390-0.406=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1324.055-1324.053=0.002
σ0.102-0.105=-0.003
min1323.923-1323.921=0.001
max1324.188-1324.193=-0.005
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean1.952-1.942=0.010
σ0.121-0.116=0.005
min1.823-1.829=-0.006
max2.104-2.097=0.008
iters=5
new-facts=6402
prior-facts=1
mean1562.088-1562.080=0.008
σ6.916-6.925=-0.009
min1558.795-1558.785=0.010
max1574.456-1574.464=-0.008
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean2.351-2.312=0.039
σ0.316-0.264=0.051
min2.073-2.078=-0.006
max2.720-2.700=0.020
iters=5
new-facts=6402
prior-facts=6402
mean1891.965-1891.969=-0.004
σ0.067-0.065=0.002
min1891.849-1891.854=-0.005
max1892.012-1892.010=0.002
mean1782.000-1769.600=12.400
σ158.770-172.060=-13.290
min1661.000-1629.000=32.000
max2036.000-2035.000=1.000
mean2.925-2.895=0.030
σ0.115-0.052=0.064
min2.823-2.858=-0.035
max3.122-2.986=0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.211=-0.008
σ0.344-0.397=-0.053
min0.918-0.918=-0.000
max1.784-1.881=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.946-443.946=-0.001
σ575.147-575.144=0.003
min156.364-156.361=0.002
max1306.666-1306.662=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean0.527-0.542=-0.015
σ0.519-0.543=-0.023
min0.264-0.269=-0.005
max1.306-1.356=-0.050
policies=20
mean1563.919-1563.913=0.007
σ0.327-0.316=0.011
min1563.733-1563.733=-0.000
max1564.409-1564.386=0.023
mean920.000
σ0.000
min920.000
max920.000
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean2.615-2.611=0.005
σ0.015-0.011=0.004
min2.594-2.601=-0.007
max2.625-2.623=0.002
policies=200
mean15646.920-15646.994=-0.074
σ0.148-0.086=0.062
min15646.710-15646.924=-0.213
max15647.057-15647.119=-0.062
mean9200.000
σ0.000
min9200.000
max9200.000
mean1661.000-1629.000=32.000
σ0.000
min1661.000-1629.000=32.000
max1661.000-1629.000=32.000
mean26.630-26.537=0.093
σ0.302-0.057=0.246
min26.350-26.467=-0.117
max26.934-26.590=0.344