Compare commits

Home / Compare 72c8b3dd .. 2c959f5d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.380=0.000
σ0.045-0.049=-0.003
min70.352-70.351=0.000
max70.506-70.516=-0.009
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.162-0.160=0.002
σ0.003-0.003=-0.001
min0.159-0.156=0.002
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.002=0.001
min21.140-21.140=-0.000
max21.148-21.148=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.065=0.001
σ0.003-0.003=-0.000
min0.062-0.060=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.388=-0.000
σ0.359-0.361=-0.002
min1751.820-1751.823=-0.003
max1752.973-1752.973=0.000
mean1631.200-1653.750=-22.550
σ597.944-644.459=-46.515
min621.000-620.000=1.000
max2412.000-2777.000=-365.000
mean2.800-2.826=-0.027
σ0.145-0.139=0.006
min2.307-2.516=-0.208
max2.988-3.110=-0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.128=0.001
σ0.006-0.009=-0.003
min270.123-270.116=0.007
max270.140-270.141=-0.002
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean0.382-0.380=0.001
σ0.005-0.002=0.004
min0.378-0.378=-0.001
max0.391-0.382=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.584-1930.589=-0.006
σ0.023-0.009=0.013
min1930.551-1930.576=-0.025
max1930.602-1930.602=0.000
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean2.510-2.648=-0.138
σ0.088-0.132=-0.044
min2.444-2.438=0.006
max2.629-2.791=-0.162
iters=5
new-facts=6402
prior-facts=1
mean4751.047-4750.946=0.101
σ0.889-0.968=-0.079
min4750.456-4749.929=0.527
max4752.614-4752.558=0.057
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean8.821-8.692=0.129
σ0.463-0.394=0.069
min8.302-8.025=0.277
max9.491-9.043=0.449
iters=5
new-facts=6402
prior-facts=6402
mean4941.528-4941.531=-0.004
σ0.082-0.082=-0.000
min4941.461-4941.453=0.009
max4941.619-4941.635=-0.017
mean2955.200-3024.000=-68.800
σ263.739-256.790=6.949
min2601.000-2777.000=-176.000
max3304.000-3289.000=15.000
mean8.483-8.857=-0.374
σ0.096-0.444=-0.347
min8.387-8.529=-0.142
max8.584-9.613=-1.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.729-0.998=0.731
σ0.175-0.126=0.049
min1.446-0.939=0.508
max1.909-1.223=0.686

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.355-466.364=-0.009
σ575.917-575.918=-0.001
min178.393-178.397=-0.004
max1330.230-1330.241=-0.011
mean84.000
σ8.000
min80.000
max96.000
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean0.562-0.445=0.117
σ0.573-0.303=0.270
min0.267-0.289=-0.023
max1.422-0.900=0.522
policies=20
mean1784.213-1784.277=-0.065
σ0.332-0.341=-0.010
min1783.991-1784.023=-0.032
max1784.706-1784.778=-0.072
mean800.000
σ0.000
min800.000
max800.000
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean2.785-2.864=-0.078
σ0.020-0.070=-0.050
min2.774-2.779=-0.005
max2.814-2.948=-0.134
policies=200
mean17848.765-17848.783=-0.018
σ0.589-0.610=-0.021
min17848.372-17848.375=-0.003
max17849.627-17849.687=-0.060
mean8000.000
σ0.000
min8000.000
max8000.000
mean2412.000-2777.000=-365.000
σ0.000
min2412.000-2777.000=-365.000
max2412.000-2777.000=-365.000
mean27.959-28.148=-0.189
σ0.078-0.177=-0.099
min27.862-27.984=-0.122
max28.029-28.381=-0.352