Compare commits

Home / Compare 1718b7b7 .. 69243797

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.395=-0.001
σ0.044-0.045=-0.001
min70.370-70.368=0.002
max70.515-70.521=-0.005
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.161-0.161=-0.000
σ0.004-0.004=0.000
min0.157-0.157=-0.000
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=-0.000
min21.139-21.138=0.002
max21.147-21.148=-0.001
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.064-0.065=-0.001
σ0.002-0.002=0.000
min0.062-0.063=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.359-0.363=-0.004
min1751.825-1751.821=0.005
max1752.977-1753.001=-0.025
mean1657.800-1660.450=-2.650
σ634.043-638.185=-4.141
min618.000-621.000=-3.000
max2788.000-2814.000=-26.000
mean2.802-2.777=0.025
σ0.182-0.182=-0.000
min2.289-2.289=-0.000
max3.067-2.998=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.240-270.242=-0.001
σ0.010-0.010=-0.000
min270.225-270.228=-0.002
max270.252-270.255=-0.002
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean0.384-0.385=-0.001
σ0.010-0.010=-0.000
min0.378-0.373=0.004
max0.401-0.400=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.701-1930.700=0.000
σ0.005-0.010=-0.005
min1930.694-1930.686=0.009
max1930.706-1930.709=-0.003
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean2.504-2.547=-0.043
σ0.054-0.106=-0.052
min2.453-2.426=0.027
max2.595-2.703=-0.108
iters=5
new-facts=6402
prior-facts=1
mean4751.385-4751.334=0.051
σ0.866-0.930=-0.063
min4750.868-4750.595=0.272
max4752.926-4752.936=-0.010
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean8.620-8.249=0.371
σ0.380-0.632=-0.251
min8.059-7.711=0.347
max9.032-9.246=-0.214
iters=5
new-facts=6402
prior-facts=6402
mean4941.861-4941.860=0.000
σ0.023-0.028=-0.005
min4941.833-4941.830=0.003
max4941.891-4941.891=-0.000
mean3054.600-3064.600=-10.000
σ258.394-316.472=-58.079
min2788.000-2814.000=-26.000
max3422.000-3548.000=-126.000
mean8.695-8.429=0.267
σ0.248-0.165=0.083
min8.449-8.210=0.239
max9.017-8.669=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.083=-0.059
σ0.141-0.113=0.028
min0.928-0.939=-0.010
max1.252-1.255=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.751-466.756=-0.005
σ575.930-575.942=-0.012
min178.780-178.778=0.002
max1330.646-1330.668=-0.022
mean86.250
σ8.500
min82.000
max99.000
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean0.433-0.441=-0.008
σ0.286-0.299=-0.013
min0.286-0.290=-0.004
max0.862-0.889=-0.027
policies=20
mean1788.133-1788.141=-0.008
σ0.390-0.377=0.012
min1787.865-1787.867=-0.002
max1788.709-1788.696=0.013
mean820.000
σ0.000
min820.000
max820.000
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean2.864-2.887=-0.023
σ0.111-0.054=0.057
min2.769-2.843=-0.074
max3.020-2.966=0.054
policies=200
mean17888.038-17888.049=-0.011
σ0.560-0.437=0.123
min17887.606-17887.756=-0.150
max17888.848-17888.698=0.150
mean8200.000
σ0.000
min8200.000
max8200.000
mean2788.000-2814.000=-26.000
σ0.000
min2788.000-2814.000=-26.000
max2788.000-2814.000=-26.000
mean28.093-28.055=0.038
σ0.046-0.104=-0.058
min28.026-27.989=0.037
max28.125-28.210=-0.085