Compare commits

Home / Compare 2d2d6a4c .. 9134f8b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727
σ1.039
min35.919
max38.461
mean3984.000
σ0.000
min3984.000
max3984.000
mean0.075
σ0.001
min0.073
max0.078
cache=y
dps=1
iters=10
policies=100
mean26.711
σ0.649
min26.203
max27.467
mean3984.000
σ0.000
min3984.000
max3984.000
mean0.060
σ0.001
min0.058
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1755.329=1.030
σ0.373-0.368=0.005
min1755.778-1754.768=1.009
max1756.960-1755.921=1.039
mean1655.350-1663.100=-7.750
σ627.298-623.678=3.619
min681.000-683.000=-2.000
max2605.000-2655.000=-50.000
mean2.243-2.252=-0.008
σ0.158-0.098=0.060
min2.094-2.123=-0.029
max2.780-2.471=0.309

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.673-277.713=0.961
σ0.012-0.009=0.003
min278.663-277.699=0.964
max278.693-277.722=0.971
mean2605.000-2655.000=-50.000
σ0.000
min2605.000-2655.000=-50.000
max2605.000-2655.000=-50.000
mean0.423-0.408=0.014
σ0.010-0.001=0.009
min0.417-0.406=0.011
max0.440-0.409=0.031
iters=5
new-facts=1
prior-facts=6402
mean2268.839-2267.879=0.960
σ0.016-0.018=-0.002
min2268.811-2267.856=0.955
max2268.852-2267.900=0.952
mean2605.000-2655.000=-50.000
σ0.000
min2605.000-2655.000=-50.000
max2605.000-2655.000=-50.000
mean2.964-3.089=-0.125
σ0.119-0.166=-0.046
min2.884-2.818=0.067
max3.174-3.209=-0.035
iters=5
new-facts=6402
prior-facts=1
mean4952.317-4954.961=-2.645
σ0.868-0.913=-0.044
min4951.868-4954.066=-2.197
max4953.866-4956.505=-2.639
mean2605.000-2655.000=-50.000
σ0.000
min2605.000-2655.000=-50.000
max2605.000-2655.000=-50.000
mean8.095-7.810=0.284
σ0.270-0.170=0.100
min7.712-7.614=0.097
max8.355-8.073=0.282
iters=5
new-facts=6402
prior-facts=6402
mean5166.979-5169.787=-2.808
σ0.162-0.091=0.070
min5166.690-5169.683=-2.993
max5167.065-5169.876=-2.811
mean3421.200-3361.200=60.000
σ458.573-428.270=30.303
min2779.000-2940.000=-161.000
max3984.000-3796.000=188.000
mean9.268-9.302=-0.035
σ0.353-0.201=0.152
min8.745-9.060=-0.315
max9.718-9.518=0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.143-1.562=-0.420
σ0.252-0.338=-0.086
min0.935-1.141=-0.206
max1.534-1.844=-0.310

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.254-456.323=3.931
σ572.608-572.604=0.004
min173.949-170.019=3.931
max1319.166-1315.229=3.937
mean79.500
σ7.000
min76.000
max90.000
mean435.000-431.000=4.000
σ0.000
min435.000-431.000=4.000
max435.000-431.000=4.000
mean0.553-0.561=-0.008
σ0.560-0.580=-0.020
min0.271-0.262=0.010
max1.393-1.432=-0.039
policies=20
mean1739.999-1700.732=39.268
σ0.326-0.300=0.026
min1739.762-1700.510=39.252
max1740.478-1701.170=39.308
mean760.000
σ0.000
min760.000
max760.000
mean445.000-444.750=0.250
σ9.381-12.176=-2.795
min435.000-431.000=4.000
max453.000-455.000=-2.000
mean2.664-2.614=0.050
σ0.008-0.018=-0.010
min2.654-2.595=0.059
max2.671-2.637=0.034
policies=200
mean17409.298-17016.723=392.575
σ0.046-0.079=-0.033
min17409.244-17016.609=392.635
max17409.357-17016.792=392.565
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-491.500=-1.750
σ3.862-3.697=0.165
min486.000-487.000=-1.000
max495.000
mean26.876-26.325=0.551
σ0.105-0.105=0.000
min26.782-26.202=0.580
max27.014-26.453=0.561