Compare commits

Home / Compare b0e392b7 .. c41a3920

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.001
σ0.047-0.050=-0.003
min31.001-31.000=0.001
max31.171-31.179=-0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.077-0.079=-0.002
σ0.004-0.004=-0.000
min0.071-0.072=-0.001
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.004-0.002=0.001
min21.137-21.137=-0.001
max21.147-21.145=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.057-0.063=-0.006
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.409=0.004
σ0.361-0.359=0.002
min1750.848-1750.848=-0.000
max1751.998-1751.994=0.004
mean1660.500-1663.100=-2.600
σ633.821-638.992=-5.171
min624.000-620.000=4.000
max2774.000-2818.000=-44.000
mean2.875-2.824=0.051
σ0.117-0.153=-0.036
min2.628-2.497=0.131
max3.138-3.124=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.787-271.645=-4.857
σ0.010-0.009=0.001
min266.778-271.633=-4.854
max266.799-271.654=-4.855
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean0.365-0.386=-0.021
σ0.001-0.011=-0.010
min0.363-0.377=-0.014
max0.366-0.403=-0.037
iters=5
new-facts=1
prior-facts=6402
mean1927.216-1932.094=-4.878
σ0.009-0.015=-0.006
min1927.206-1932.078=-4.872
max1927.228-1932.109=-4.880
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean2.977-2.621=0.356
σ0.095-0.159=-0.064
min2.866-2.425=0.440
max3.118-2.841=0.277
iters=5
new-facts=6402
prior-facts=1
mean4747.730-4752.579=-4.849
σ0.803-0.854=-0.051
min4747.295-4752.061=-4.766
max4749.162-4754.098=-4.936
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean8.298-8.500=-0.203
σ0.698-0.594=0.103
min7.682-7.732=-0.050
max9.191-9.130=0.061
iters=5
new-facts=6402
prior-facts=6402
mean4938.168-4943.043=-4.875
σ0.079-0.076=0.004
min4938.105-4942.983=-4.878
max4938.266-4943.128=-4.862
mean3038.400-3061.200=-22.800
σ313.774-314.276=-0.502
min2774.000-2818.000=-44.000
max3501.000-3542.000=-41.000
mean8.387-8.426=-0.039
σ0.124-0.068=0.056
min8.259-8.317=-0.059
max8.595-8.498=0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.090=-0.055
σ0.140-0.113=0.028
min0.939-0.955=-0.016
max1.259-1.269=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.120-465.123=-0.002
σ575.757-575.767=-0.010
min177.236-177.232=0.004
max1328.756-1328.773=-0.018
mean79.750
σ7.500
min76.000
max91.000
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean0.446-0.444=0.002
σ0.307-0.311=-0.004
min0.291-0.284=0.007
max0.907-0.911=-0.004
policies=20
mean1772.645-1772.604=0.041
σ0.339-0.330=0.009
min1772.395-1772.353=0.042
max1773.139-1773.080=0.058
mean760.000
σ0.000
min760.000
max760.000
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean2.829-2.864=-0.035
σ0.102-0.108=-0.006
min2.752-2.752=-0.000
max2.974-3.008=-0.034
policies=200
mean17732.346-17732.514=-0.168
σ0.602-0.512=0.091
min17732.009-17732.209=-0.200
max17733.249-17733.280=-0.031
mean7600.000
σ0.000
min7600.000
max7600.000
mean2774.000-2818.000=-44.000
σ0.000
min2774.000-2818.000=-44.000
max2774.000-2818.000=-44.000
mean27.760-27.846=-0.086
σ0.215-0.188=0.027
min27.502-27.733=-0.232
max27.988-28.127=-0.139