Compare commits

Home / Compare d4f5fcf4 .. 34137bd6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-36.855=-0.904
σ0.103-0.632=-0.529
min35.905-35.945=-0.040
max36.243-37.528=-1.285
mean410.000-3776.000=-3366.000
σ0.000
min410.000-3776.000=-3366.000
max410.000-3776.000=-3366.000
mean0.078-0.078=0.000
σ0.004-0.002=0.002
min0.074-0.075=-0.001
max0.086-0.082=0.003
cache=y
dps=1
iters=10
policies=100
mean26.201-26.585=-0.385
σ0.005-0.605=-0.600
min26.195-26.206=-0.010
max26.208-27.464=-1.256
mean410.000-3776.000=-3366.000
σ0.000
min410.000-3776.000=-3366.000
max410.000-3776.000=-3366.000
mean0.060-0.059=0.001
σ0.004-0.002=0.002
min0.056-0.057=-0.000
max0.069-0.062=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.299-1756.367=-0.069
σ0.366-0.374=-0.008
min1755.721-1755.792=-0.072
max1756.889-1756.959=-0.071
mean1640.700-1654.600=-13.900
σ635.321-625.718=9.603
min617.000-612.000=5.000
max2686.000-2662.000=24.000
mean2.379-2.292=0.087
σ0.111-0.165=-0.054
min2.258-2.138=0.120
max2.633-2.791=-0.159

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.817-278.703=0.114
σ0.005-0.011=-0.006
min278.809-278.692=0.117
max278.823-278.719=0.103
mean2686.000-2662.000=24.000
σ0.000
min2686.000-2662.000=24.000
max2686.000-2662.000=24.000
mean0.408-0.419=-0.011
σ0.005-0.001=0.004
min0.405-0.418=-0.013
max0.417-0.421=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.875-2268.858=0.018
σ0.019-0.018=0.002
min2268.850-2268.834=0.016
max2268.895-2268.874=0.021
mean2686.000-2662.000=24.000
σ0.000
min2686.000-2662.000=24.000
max2686.000-2662.000=24.000
mean3.127-3.176=-0.049
σ0.183-0.195=-0.012
min2.884-2.851=0.034
max3.383-3.307=0.076
iters=5
new-facts=6402
prior-facts=1
mean4954.277-4952.359=1.917
σ0.801-0.777=0.024
min4953.857-4951.941=1.916
max4955.706-4953.748=1.958
mean2686.000-2662.000=24.000
σ0.000
min2686.000-2662.000=24.000
max2686.000-2662.000=24.000
mean7.887-7.825=0.062
σ0.264-0.173=0.091
min7.643-7.636=0.006
max8.274-8.091=0.183
iters=5
new-facts=6402
prior-facts=6402
mean5168.783-5166.998=1.785
σ0.087-0.158=-0.071
min5168.717-5166.715=2.001
max5168.881-5167.079=1.802
mean3301.600-3362.200=-60.600
σ500.117-408.206=91.911
min2686.000-2960.000=-274.000
max3790.000-3776.000=14.000
mean9.331-9.319=0.011
σ0.167-0.251=-0.083
min9.127-9.021=0.107
max9.567-9.670=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.630=-0.657
σ0.057-0.309=-0.251
min0.938-1.253=-0.315
max1.073-1.911=-0.838

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.808-460.259=-0.452
σ571.584-572.607=-1.023
min174.008-173.955=0.053
max1317.184-1319.171=-1.986
mean79.500
σ7.000
min76.000
max90.000
mean2686.000-436.000=2250.000
σ0.000
min2686.000-436.000=2250.000
max2686.000-436.000=2250.000
mean0.537-0.559=-0.021
σ0.535-0.560=-0.025
min0.267-0.274=-0.008
max1.340-1.399=-0.059
policies=20
mean1740.299-1740.064=0.234
σ0.301-0.325=-0.025
min1740.120-1739.829=0.291
max1740.748-1740.542=0.207
mean760.000
σ0.000
min760.000
max760.000
mean2686.000-445.750=2240.250
σ0.000-9.605=-9.605
min2686.000-436.000=2250.000
max2686.000-454.000=2232.000
mean2.670-2.651=0.018
σ0.021-0.012=0.009
min2.646-2.640=0.006
max2.697-2.666=0.031
policies=200
mean17410.094-17409.766=0.328
σ0.383-0.311=0.072
min17409.857-17409.333=0.525
max17410.665-17410.041=0.625
mean7600.000
σ0.000
min7600.000
max7600.000
mean2686.000-489.750=2196.250
σ0.000-2.630=-2.630
min2686.000-486.000=2200.000
max2686.000-492.000=2194.000
mean26.956-26.871=0.085
σ0.104-0.128=-0.023
min26.802-26.734=0.068
max27.024-26.990=0.033