Compare commits

Home / Compare 7dc7d7f9 .. 41b41eb8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.000
σ0.045-0.048=-0.003
min70.751-70.754=-0.002
max70.905-70.914=-0.009
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.159-0.159=0.000
σ0.005-0.004=0.000
min0.151-0.152=-0.001
max0.166-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.003-0.002=0.001
min21.488-21.489=-0.001
max21.497-21.496=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.001
σ0.359-0.359=-0.000
min1753.536-1753.529=0.007
max1754.674-1754.679=-0.004
mean1638.400-1657.600=-19.200
σ617.915-630.138=-12.223
min642.000-626.000=16.000
max2478.000-2773.000=-295.000
mean2.809-2.827=-0.018
σ0.140-0.193=-0.052
min2.437-2.181=0.256
max3.025-3.097=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.954=0.001
σ0.006-0.006=0.001
min271.945-271.947=-0.002
max271.962-271.961=0.000
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean0.387-0.384=0.003
σ0.014-0.008=0.006
min0.378-0.380=-0.002
max0.412-0.398=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.327-1932.324=0.003
σ0.009-0.013=-0.004
min1932.316-1932.311=0.005
max1932.337-1932.340=-0.003
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean2.966-2.978=-0.012
σ0.048-0.136=-0.088
min2.904-2.746=0.157
max3.012-3.078=-0.065
iters=5
new-facts=6402
prior-facts=1
mean4752.979-4753.090=-0.111
σ1.019-0.913=0.106
min4752.027-4752.599=-0.572
max4754.714-4754.714=-0.000
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean8.576-8.569=0.007
σ0.618-0.425=0.193
min7.585-7.941=-0.356
max9.134-8.917=0.217
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.557=0.001
σ0.017-0.011=0.006
min4943.535-4943.544=-0.009
max4943.575-4943.570=0.005
mean3010.200-2972.000=38.200
σ294.684-234.710=59.974
min2606.000-2773.000=-167.000
max3381.000-3341.000=40.000
mean8.495-8.382=0.114
σ0.102-0.082=0.021
min8.379-8.285=0.093
max8.593-8.509=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-1.016=0.781
σ0.129-0.138=-0.009
min1.573-0.923=0.651
max1.893-1.245=0.648

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.631-468.661=-0.030
σ574.883-574.888=-0.005
min181.185-181.208=-0.023
max1330.956-1330.993=-0.037
mean88.250
σ8.500
min84.000
max101.000
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean0.549-0.447=0.102
σ0.512-0.297=0.215
min0.289-0.297=-0.008
max1.317-0.892=0.425
policies=20
mean1812.203-1812.307=-0.103
σ0.394-0.314=0.080
min1811.945-1812.106=-0.161
max1812.784-1812.775=0.010
mean840.000
σ0.000
min840.000
max840.000
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean2.843-2.919=-0.076
σ0.025-0.117=-0.092
min2.818-2.831=-0.013
max2.867-3.083=-0.216
policies=200
mean18129.056-18129.205=-0.148
σ0.588-0.492=0.096
min18128.664-18128.813=-0.149
max18129.926-18129.922=0.004
mean8400.000
σ0.000
min8400.000
max8400.000
mean2478.000-2773.000=-295.000
σ0.000
min2478.000-2773.000=-295.000
max2478.000-2773.000=-295.000
mean28.722-28.616=0.106
σ0.088-0.089=-0.001
min28.622-28.533=0.090
max28.800-28.742=0.058