Compare commits

Home / Compare 23af6e26 .. 6bc6ae62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.950-36.727=-0.777
σ0.103-1.031=-0.928
min35.906-35.933=-0.027
max36.243-38.450=-2.207
mean415.000-3890.000=-3475.000
σ0.000
min415.000-3890.000=-3475.000
max415.000-3890.000=-3475.000
mean0.077-0.076=0.001
σ0.004-0.002=0.003
min0.073-0.074=-0.000
max0.085-0.079=0.005
cache=y
dps=1
iters=10
policies=100
mean26.200-26.711=-0.511
σ0.004-0.648=-0.644
min26.194-26.205=-0.011
max26.208-27.469=-1.261
mean415.000-3890.000=-3475.000
σ0.000
min415.000-3890.000=-3475.000
max415.000-3890.000=-3475.000
mean0.060-0.060=0.001
σ0.003-0.001=0.002
min0.058-0.059=-0.001
max0.069-0.061=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.299-1756.356=-0.057
σ0.367-0.372=-0.005
min1755.725-1755.786=-0.062
max1756.889-1756.959=-0.070
mean1642.700-1669.350=-26.650
σ634.920-646.204=-11.283
min619.000-632.000=-13.000
max2685.000-2858.000=-173.000
mean2.375-2.259=0.116
σ0.129-0.134=-0.005
min2.172-2.110=0.062
max2.656-2.742=-0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.820-278.674=0.146
σ0.005-0.009=-0.004
min278.814-278.664=0.151
max278.826-278.688=0.139
mean2685.000-2858.000=-173.000
σ0.000
min2685.000-2858.000=-173.000
max2685.000-2858.000=-173.000
mean0.412-0.436=-0.024
σ0.003-0.010=-0.007
min0.410-0.419=-0.009
max0.417-0.442=-0.025
iters=5
new-facts=1
prior-facts=6402
mean2268.875-2268.842=0.033
σ0.011-0.013=-0.003
min2268.860-2268.820=0.040
max2268.887-2268.854=0.033
mean2685.000-2858.000=-173.000
σ0.000
min2685.000-2858.000=-173.000
max2685.000-2858.000=-173.000
mean2.908-3.125=-0.217
σ0.059-0.197=-0.139
min2.869-2.915=-0.046
max3.011-3.334=-0.322
iters=5
new-facts=6402
prior-facts=1
mean4954.235-4952.364=1.871
σ0.811-0.767=0.045
min4953.749-4951.971=1.778
max4955.668-4953.733=1.935
mean2685.000-2858.000=-173.000
σ0.000
min2685.000-2858.000=-173.000
max2685.000-2858.000=-173.000
mean8.007-7.777=0.230
σ0.220-0.133=0.087
min7.725-7.631=0.094
max8.276-7.931=0.345
iters=5
new-facts=6402
prior-facts=6402
mean5168.789-5167.058=1.731
σ0.078-0.014=0.064
min5168.729-5167.043=1.686
max5168.881-5167.075=1.806
mean3397.000-3342.800=54.200
σ460.689-396.707=63.981
min2813.000-2858.000=-45.000
max4015.000-3890.000=125.000
mean9.474-9.452=0.022
σ0.370-0.426=-0.056
min8.949-9.009=-0.060
max9.777-10.151=-0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.098=-0.104
σ0.067-0.246=-0.178
min0.937-0.917=0.020
max1.074-1.465=-0.391

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.805-460.257=-0.451
σ571.587-572.607=-1.020
min174.007-173.952=0.056
max1317.186-1319.167=-1.981
mean79.500
σ7.000
min76.000
max90.000
mean2685.000-437.000=2248.000
σ0.000
min2685.000-437.000=2248.000
max2685.000-437.000=2248.000
mean0.542-0.563=-0.021
σ0.541-0.584=-0.043
min0.267-0.267=-0.000
max1.353-1.440=-0.086
policies=20
mean1740.326-1740.016=0.310
σ0.325-0.333=-0.008
min1740.115-1739.773=0.342
max1740.811-1740.505=0.306
mean760.000
σ0.000
min760.000
max760.000
mean2685.000-448.500=2236.500
σ0.000-10.116=-10.116
min2685.000-437.000=2248.000
max2685.000-457.000=2228.000
mean2.695-2.667=0.028
σ0.011-0.016=-0.005
min2.683-2.652=0.031
max2.708-2.687=0.020
policies=200
mean17410.173-17409.462=0.711
σ0.458-0.060=0.398
min17409.926-17409.387=0.539
max17410.859-17409.517=1.342
mean7600.000
σ0.000
min7600.000
max7600.000
mean2685.000-493.250=2191.750
σ0.000-2.986=-2.986
min2685.000-490.000=2195.000
max2685.000-497.000=2188.000
mean27.036-26.789=0.247
σ0.072-0.095=-0.023
min26.955-26.675=0.280
max27.119-26.904=0.215