Compare commits

Home / Compare 79ed00a2 .. 7f254d85

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.783=0.001
σ0.047-0.047=0.000
min70.749-70.751=-0.002
max70.914-70.914=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.161-0.160=0.001
σ0.003-0.003=-0.000
min0.158-0.158=0.001
max0.166-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.003=-0.001
min21.489-21.490=-0.001
max21.495-21.498=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.063=0.003
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.092=0.001
σ0.361-0.361=-0.000
min1753.537-1753.529=0.008
max1754.676-1754.679=-0.003
mean1661.600-1667.750=-6.150
σ634.679-630.113=4.566
min629.000-669.000=-40.000
max2777.000-2621.000=156.000
mean2.813-2.756=0.057
σ0.172-0.217=-0.046
min2.378-2.254=0.124
max3.100-3.017=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.955=-0.002
σ0.006-0.006=-0.000
min271.944-271.948=-0.005
max271.959-271.961=-0.003
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean0.383-0.383=0.000
σ0.008-0.005=0.003
min0.378-0.380=-0.003
max0.397-0.392=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.327-1932.333=-0.006
σ0.016-0.007=0.009
min1932.305-1932.327=-0.023
max1932.346-1932.344=0.002
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean3.071-2.926=0.145
σ0.158-0.255=-0.097
min2.862-2.599=0.263
max3.236-3.238=-0.002
iters=5
new-facts=6402
prior-facts=1
mean4753.020-4753.046=-0.026
σ0.542-0.919=-0.376
min4752.708-4752.589=0.119
max4753.985-4754.688=-0.703
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean8.251-8.645=-0.394
σ0.303-0.483=-0.181
min7.774-7.797=-0.023
max8.548-8.963=-0.416
iters=5
new-facts=6402
prior-facts=6402
mean4943.555-4943.551=0.004
σ0.023-0.017=0.006
min4943.522-4943.533=-0.011
max4943.580-4943.574=0.007
mean3052.200-2970.400=81.800
σ336.117-264.146=71.971
min2777.000-2621.000=156.000
max3559.000-3324.000=235.000
mean8.434-8.503=-0.068
σ0.120-0.092=0.028
min8.332-8.431=-0.099
max8.642-8.641=0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.174=-0.135
σ0.109-0.255=-0.146
min0.934-0.926=0.008
max1.196-1.536=-0.340

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.658-468.639=0.019
σ574.881-574.891=-0.010
min181.212-181.189=0.024
max1330.980-1330.976=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean0.480-0.571=-0.091
σ0.375-0.557=-0.183
min0.289-0.286=0.003
max1.042-1.407=-0.365
policies=20
mean1812.394-1812.203=0.191
σ0.381-0.382=-0.002
min1812.124-1811.950=0.174
max1812.950-1812.768=0.182
mean840.000
σ0.000
min840.000
max840.000
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean2.960-2.868=0.093
σ0.071-0.050=0.021
min2.897-2.837=0.061
max3.047-2.942=0.105
policies=200
mean18129.183-18129.220=-0.037
σ0.539-0.509=0.030
min18128.833-18128.954=-0.120
max18129.985-18129.983=0.002
mean8400.000
σ0.000
min8400.000
max8400.000
mean2777.000-2621.000=156.000
σ0.000
min2777.000-2621.000=156.000
max2777.000-2621.000=156.000
mean28.681-28.635=0.045
σ0.021-0.125=-0.104
min28.663-28.535=0.128
max28.711-28.806=-0.095