Compare commits

Home / Compare 65163e11 .. d81d64a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.983-35.982=0.002
σ0.100-0.098=0.002
min35.942-35.940=0.003
max36.267-36.260=0.007
mean4135.000-4116.000=19.000
σ0.000
min4135.000-4116.000=19.000
max4135.000-4116.000=19.000
mean0.076-0.075=0.001
σ0.001-0.001=0.000
min0.074-0.074=0.001
max0.077-0.076=0.001
cache=y
dps=1
iters=10
policies=100
mean26.211-26.211=-0.001
σ0.004-0.003=0.000
min26.207-26.207=-0.000
max26.219-26.216=0.003
mean4135.000-4116.000=19.000
σ0.000
min4135.000-4116.000=19.000
max4135.000-4116.000=19.000
mean0.060-0.059=0.001
σ0.000-0.000=-0.000
min0.060-0.059=0.001
max0.061-0.060=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.328-1756.370=-38.042
σ170.162-0.373=169.788
min995.393-1755.791=-760.398
max1756.973-1756.968=0.005
mean1618.350-1653.150=-34.800
σ612.250-624.436=-12.187
min616.000-619.000=-3.000
max2654.000-2641.000=13.000
mean2.224-2.298=-0.074
σ0.267-0.165=0.102
min1.271-2.155=-0.884
max2.759-2.739=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.701-278.697=0.004
σ0.010-0.012=-0.002
min278.690-278.687=0.003
max278.717-278.718=-0.001
mean2654.000-2641.000=13.000
σ0.000
min2654.000-2641.000=13.000
max2654.000-2641.000=13.000
mean0.418-0.418=-0.000
σ0.002-0.001=0.001
min0.415-0.416=-0.001
max0.421-0.419=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.874-2268.865=0.009
σ0.005-0.010=-0.005
min2268.869-2268.847=0.022
max2268.879-2268.871=0.008
mean2654.000-2641.000=13.000
σ0.000
min2654.000-2641.000=13.000
max2654.000-2641.000=13.000
mean3.106-3.024=0.083
σ0.189-0.134=0.054
min2.878-2.928=-0.050
max3.346-3.245=0.101
iters=5
new-facts=6402
prior-facts=1
mean4952.198-4951.955=0.243
σ0.771-0.639=0.132
min4951.729-4951.316=0.414
max4953.568-4953.025=0.543
mean2654.000-2641.000=13.000
σ0.000
min2654.000-2641.000=13.000
max2654.000-2641.000=13.000
mean7.889-7.947=-0.058
σ0.276-0.369=-0.093
min7.616-7.690=-0.074
max8.348-8.596=-0.248
iters=5
new-facts=6402
prior-facts=6402
mean5166.916-5166.920=-0.003
σ0.023-0.011=0.012
min5166.886-5166.912=-0.025
max5166.948-5166.939=0.010
mean3376.400-3454.400=-78.000
σ526.876-462.553=64.323
min2907.000-2871.000=36.000
max4135.000-4116.000=19.000
mean9.121-9.362=-0.241
σ0.379-0.198=0.182
min8.540-9.179=-0.639
max9.518-9.654=-0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.050=0.008
σ0.124-0.133=-0.010
min0.947-0.921=0.026
max1.248-1.247=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.258=-0.000
σ572.607-572.607=-0.000
min173.954-173.952=0.001
max1319.169-1319.169=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean436.000-437.000=-1.000
σ0.000
min436.000-437.000=-1.000
max436.000-437.000=-1.000
mean0.548-0.542=0.006
σ0.542-0.533=0.009
min0.271-0.270=0.001
max1.361-1.341=0.020
policies=20
mean1740.043-1740.058=-0.016
σ0.335-0.324=0.011
min1739.797-1739.820=-0.023
max1740.534-1740.532=0.002
mean760.000
σ0.000
min760.000
max760.000
mean445.750-447.500=-1.750
σ9.605-9.950=-0.345
min436.000-437.000=-1.000
max454.000-456.000=-2.000
mean2.669-2.656=0.013
σ0.014-0.017=-0.003
min2.651-2.633=0.018
max2.680-2.673=0.007
policies=200
mean17409.808-17409.812=-0.003
σ0.081-0.026=0.055
min17409.754-17409.784=-0.030
max17409.926-17409.847=0.079
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.000-491.000=3.000
σ3.559-2.944=0.615
min490.000-488.000=2.000
max497.000-494.000=3.000
mean26.905-26.856=0.049
σ0.029-0.096=-0.067
min26.873-26.722=0.151
max26.936-26.942=-0.006