Compare commits

Home / Compare 3fe54444 .. 04f047d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.106-0.106=0.000
min35.924-35.926=-0.003
max36.274-36.274=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.075-0.077=-0.002
σ0.004-0.004=-0.000
min0.070-0.074=-0.004
max0.082-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.004-0.004=-0.000
min26.204-26.201=0.003
max26.218-26.216=0.002
mean414.900-416.000=-1.100
σ0.316-0.000=0.316
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.060-0.060=-0.000
σ0.003-0.003=-0.001
min0.057-0.057=-0.000
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.365=-0.001
σ0.372-0.370=0.002
min1757.787-1757.788=-0.001
max1758.962-1758.952=0.010
mean1658.450-1642.850=15.600
σ624.120-628.364=-4.244
min687.000-615.000=72.000
max2767.000-2771.000=-4.000
mean2.416-2.353=0.063
σ0.091-0.091=0.000
min2.317-2.150=0.167
max2.635-2.512=0.123

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-279.511=-0.003
σ0.007-0.006=0.001
min279.498-279.502=-0.004
max279.515-279.517=-0.002
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean0.409-0.408=0.002
σ0.001-0.005=-0.004
min0.408-0.403=0.005
max0.411-0.415=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2178.448-2178.440=0.008
σ0.012-0.015=-0.002
min2178.437-2178.421=0.016
max2178.468-2178.457=0.010
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean3.490-3.265=0.226
σ0.145-0.357=-0.212
min3.332-2.763=0.569
max3.696-3.619=0.078
iters=5
new-facts=6402
prior-facts=1
mean5056.384-5056.127=0.257
σ1.039-0.812=0.226
min5055.784-5055.395=0.389
max5058.222-5057.514=0.708
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean8.893-8.842=0.051
σ0.675-0.554=0.121
min8.205-8.129=0.076
max9.896-9.390=0.506
iters=5
new-facts=6402
prior-facts=6402
mean5193.762-5193.685=0.076
σ0.092-0.120=-0.028
min5193.691-5193.508=0.183
max5193.865-5193.848=0.017
mean3289.200-3236.600=52.600
σ396.219-342.575=53.644
min2767.000-2771.000=-4.000
max3671.000-3668.000=3.000
mean9.096-8.847=0.249
σ0.334-0.209=0.125
min8.761-8.667=0.094
max9.606-9.197=0.409

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.004=-0.031
σ0.058-0.137=-0.079
min0.938-0.938=0.000
max1.074-1.249=-0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.478-465.487=-0.009
σ572.662-572.677=-0.015
min179.141-179.138=0.004
max1324.471-1324.503=-0.031
mean79.500
σ7.000
min76.000
max90.000
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean0.483-0.491=-0.007
σ0.401-0.421=-0.020
min0.279-0.279=0.000
max1.085-1.122=-0.037
policies=20
mean1791.703-1791.680=0.023
σ0.331-0.351=-0.020
min1791.510-1791.452=0.058
max1792.195-1792.202=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean2.820-2.801=0.019
σ0.021-0.016=0.005
min2.806-2.783=0.023
max2.850-2.820=0.030
policies=200
mean17923.379-17923.530=-0.151
σ0.446-0.508=-0.061
min17923.020-17923.260=-0.240
max17924.031-17924.291=-0.260
mean7600.000
σ0.000
min7600.000
max7600.000
mean2767.000-2771.000=-4.000
σ0.000
min2767.000-2771.000=-4.000
max2767.000-2771.000=-4.000
mean28.399-28.222=0.177
σ0.152-0.165=-0.014
min28.270-28.091=0.179
max28.588-28.447=0.141