Compare commits

Home / Compare 37bd32f3 .. 9a2ce158

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.766-30.766=-0.000
σ0.053-0.052=0.001
min30.723-30.730=-0.007
max30.909-30.909=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.077-0.075=0.002
σ0.004-0.005=-0.001
min0.070-0.069=0.001
max0.084-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.002-0.002=0.000
min21.057-21.056=0.001
max21.065-21.064=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.062=0.001
σ0.002-0.003=-0.001
min0.062-0.058=0.003
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean32078.623-32078.620=0.003
σ0.352-0.352=0.000
min32078.107-32078.101=0.006
max32079.202-32079.195=0.006
mean2845.500-2834.700=10.800
σ800.933-755.028=45.905
min1518.000-1683.000=-165.000
max4023.000-4025.000=-2.000
mean26.410-26.046=0.363
σ1.408-1.655=-0.247
min24.032-23.744=0.287
max29.085-28.952=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.925-275.920=0.006
σ0.015-0.010=0.006
min275.903-275.906=-0.003
max275.943-275.931=0.012
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean0.401-0.402=-0.001
σ0.011-0.004=0.007
min0.395-0.398=-0.003
max0.420-0.406=0.014
iters=5
new-facts=1
prior-facts=6402
mean2168.526-2168.520=0.007
σ0.023-0.042=-0.019
min2168.489-2168.447=0.041
max2168.545-2168.546=-0.001
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean3.040-2.819=0.220
σ0.235-0.122=0.113
min2.744-2.731=0.013
max3.310-3.033=0.278
iters=5
new-facts=6402
prior-facts=1
mean5048.295-5048.320=-0.025
σ0.905-0.988=-0.084
min5047.544-5047.488=0.056
max5049.863-5050.033=-0.170
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean8.514-8.550=-0.036
σ0.366-0.525=-0.159
min7.931-8.075=-0.144
max8.847-9.385=-0.539
iters=5
new-facts=6402
prior-facts=6402
mean5179.466-5179.395=0.071
σ0.087-0.199=-0.112
min5179.389-5179.063=0.326
max5179.566-5179.553=0.013
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean8.843-8.857=-0.015
σ0.190-0.333=-0.143
min8.683-8.648=0.035
max9.067-9.433=-0.366

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.052=-0.050
σ0.142-0.169=-0.027
min0.935-0.942=-0.007
max1.255-1.338=-0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean1138.946-1138.943=0.002
σ572.655-572.652=0.003
min852.606-852.615=-0.009
max1997.928-1997.921=0.007
mean79.750
σ7.500
min76.000
max91.000
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean1.446-1.437=0.009
σ0.514-0.545=-0.031
min1.181-1.147=0.034
max2.216-2.254=-0.038
policies=20
mean8526.730-8526.714=0.016
σ0.168-0.176=-0.008
min8526.480-8526.454=0.025
max8526.835-8526.833=0.002
mean760.000
σ0.000
min760.000
max760.000
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean11.375-11.318=0.057
σ0.127-0.189=-0.062
min11.257-11.140=0.117
max11.513-11.585=-0.073
policies=200
mean85269.023-85268.811=0.211
σ0.454-0.475=-0.021
min85268.716-85268.501=0.215
max85269.698-85269.518=0.180
mean7600.000
σ0.000
min7600.000
max7600.000
mean4023.000-4025.000=-2.000
σ0.000
min4023.000-4025.000=-2.000
max4023.000-4025.000=-2.000
mean108.542-108.286=0.256
σ1.459-1.544=-0.084
min106.847-106.950=-0.103
max110.314-110.435=-0.121