Compare commits

Home / Compare 81695c17 .. 8522ea13

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.973=0.002
σ0.106-0.107=-0.000
min35.929-35.922=0.006
max36.277-36.276=0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.078-0.077=0.000
σ0.004-0.004=-0.001
min0.075-0.072=0.003
max0.085-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.003=0.001
min26.204-26.204=0.000
max26.214-26.212=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.060-0.060=-0.000
σ0.004-0.003=0.001
min0.057-0.057=0.000
max0.070-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.379=-0.015
σ0.373-0.371=0.002
min1757.786-1757.803=-0.017
max1758.964-1758.979=-0.015
mean1654.850-1630.700=24.150
σ650.059-621.710=28.349
min671.000-637.000=34.000
max2756.000-2815.000=-59.000
mean2.365-2.377=-0.013
σ0.083-0.115=-0.032
min2.247-2.283=-0.037
max2.501-2.782=-0.281

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.507-279.542=-0.034
σ0.005-0.010=-0.005
min279.501-279.532=-0.031
max279.515-279.555=-0.040
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean0.408-0.414=-0.006
σ0.007-0.008=-0.002
min0.405-0.408=-0.003
max0.420-0.425=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2178.455=-0.016
σ0.013-0.032=-0.019
min2178.421-2178.416=0.005
max2178.455-2178.493=-0.039
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean3.251-3.341=-0.090
σ0.317-0.069=0.248
min2.801-3.258=-0.456
max3.694-3.426=0.268
iters=5
new-facts=6402
prior-facts=1
mean5056.359-5056.404=-0.045
σ0.998-0.993=0.006
min5055.811-5055.795=0.016
max5058.138-5058.170=-0.031
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean8.953-8.918=0.035
σ0.578-0.615=-0.037
min8.075-8.233=-0.158
max9.589-9.684=-0.094
iters=5
new-facts=6402
prior-facts=6402
mean5193.756-5193.549=0.207
σ0.090-0.364=-0.274
min5193.678-5192.944=0.734
max5193.854-5193.881=-0.027
mean3215.600-3296.400=-80.800
σ454.919-440.858=14.061
min2756.000-2815.000=-59.000
max3846.000-3921.000=-75.000
mean8.809-8.898=-0.088
σ0.307-0.055=0.252
min8.628-8.849=-0.221
max9.352-8.982=0.370

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-0.999=-0.001
σ0.069-0.068=0.001
min0.941-0.944=-0.003
max1.074-1.079=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.487-465.557=-0.070
σ572.681-572.658=0.023
min179.144-179.221=-0.078
max1324.508-1324.544=-0.036
mean79.500
σ7.000
min76.000
max90.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean0.545-0.449=0.096
σ0.547-0.307=0.239
min0.264-0.294=-0.030
max1.365-0.910=0.455
policies=20
mean1791.681-1792.468=-0.787
σ0.346-0.343=0.003
min1791.473-1792.233=-0.760
max1792.198-1792.971=-0.773
mean760.000
σ0.000
min760.000
max760.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean2.810-2.910=-0.100
σ0.009-0.005=0.004
min2.802-2.903=-0.101
max2.820-2.913=-0.093
policies=200
mean17923.181-17929.927=-6.746
σ0.820-0.727=0.093
min17922.476-17929.297=-6.821
max17924.295-17930.751=-6.456
mean7600.000
σ0.000
min7600.000
max7600.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean28.202-28.713=-0.512
σ0.102-0.471=-0.369
min28.092-28.268=-0.175
max28.295-29.371=-1.076