Compare commits

Home / Compare 20ef0d9f .. 38ae59aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=0.000
σ0.048-0.047=0.001
min33.954-33.948=0.006
max34.110-34.107=0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.081-0.084=-0.003
σ0.005-0.005=0.000
min0.076-0.077=-0.000
max0.089-0.094=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.003-0.003=0.000
min23.311-23.314=-0.004
max23.320-23.322=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.065=-0.002
σ0.003-0.003=0.001
min0.060-0.064=-0.003
max0.072-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.302=0.001
σ0.365-0.363=0.001
min1756.730-1756.727=0.003
max1757.891-1757.895=-0.003
mean1641.500-1660.650=-19.150
σ622.036-622.492=-0.455
min623.000-668.000=-45.000
max2695.000-2593.000=102.000
mean2.378-2.388=-0.010
σ0.106-0.189=-0.083
min2.259-2.124=0.135
max2.647-2.874=-0.227

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-326.441=-0.003
σ0.060-0.060=-0.001
min326.334-326.334=-0.000
max326.480-326.478=0.002
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean0.427-0.436=-0.009
σ0.006-0.010=-0.004
min0.421-0.426=-0.004
max0.434-0.446=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.591-1988.608=-0.017
σ0.050-0.010=0.039
min1988.504-1988.591=-0.087
max1988.621-1988.617=0.004
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean2.674-2.690=-0.016
σ0.064-0.114=-0.051
min2.620-2.568=0.052
max2.785-2.865=-0.080
iters=5
new-facts=6402
prior-facts=1
mean4813.336-4813.499=-0.162
σ7.784-7.749=0.035
min4809.491-4809.895=-0.404
max4827.256-4827.360=-0.103
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean8.813-8.780=0.033
σ0.273-0.684=-0.411
min8.486-7.717=0.769
max9.101-9.481=-0.380
iters=5
new-facts=6402
prior-facts=6402
mean5001.018-5000.937=0.081
σ0.031-0.158=-0.127
min5000.987-5000.657=0.330
max5001.059-5001.030=0.029
mean2991.600-2932.000=59.600
σ251.665-357.472=-105.807
min2695.000-2593.000=102.000
max3314.000-3455.000=-141.000
mean9.912-9.715=0.197
σ0.206-0.242=-0.035
min9.732-9.364=0.369
max10.234-10.045=0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.254=-0.239
σ0.146-0.339=-0.194
min0.913-0.952=-0.039
max1.236-1.748=-0.512

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-464.439=0.003
σ574.786-574.791=-0.004
min177.042-177.038=0.004
max1326.622-1326.625=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean0.553-0.576=-0.023
σ0.557-0.597=-0.040
min0.273-0.273=0.000
max1.389-1.472=-0.083
policies=20
mean1770.754-1770.731=0.023
σ0.355-0.354=0.000
min1770.522-1770.493=0.030
max1771.283-1771.257=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean2.722-2.709=0.013
σ0.013-0.013=-0.000
min2.707-2.696=0.011
max2.737-2.723=0.014
policies=200
mean17714.797-17714.890=-0.093
σ0.458-0.548=-0.090
min17714.385-17714.457=-0.071
max17715.450-17715.693=-0.243
mean8400.000
σ0.000
min8400.000
max8400.000
mean2695.000-2593.000=102.000
σ0.000
min2695.000-2593.000=102.000
max2695.000-2593.000=102.000
mean27.536-27.496=0.040
σ0.230-0.078=0.152
min27.304-27.420=-0.116
max27.831-27.579=0.252