Compare commits

Home / Compare 7619f186 .. 3eef2974

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.050-0.050=0.000
min35.583-35.588=-0.005
max35.755-35.756=-0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.085-0.086=-0.001
σ0.005-0.005=0.000
min0.078-0.083=-0.005
max0.094-0.095=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.004=-0.002
min24.043-24.043=-0.000
max24.050-24.054=-0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.066-0.068=-0.003
σ0.003-0.003=-0.000
min0.061-0.066=-0.005
max0.068-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.062-1757.061=0.001
σ0.364-0.364=0.000
min1756.489-1756.489=0.000
max1757.648-1757.649=-0.001
mean1650.000-1660.150=-10.150
σ623.394-620.080=3.313
min640.000-671.000=-31.000
max2828.000-2589.000=239.000
mean2.363-2.358=0.006
σ0.066-0.120=-0.054
min2.272-2.186=0.086
max2.522-2.674=-0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.895-423.106=-97.211
σ0.040-0.076=-0.037
min325.826-422.970=-97.145
max325.926-423.146=-97.220
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean0.431-0.573=-0.143
σ0.007-0.002=0.005
min0.425-0.571=-0.146
max0.441-0.577=-0.136
iters=5
new-facts=1
prior-facts=6402
mean1988.062-2122.366=-134.304
σ0.008-0.043=-0.035
min1988.051-2122.291=-134.241
max1988.071-2122.402=-134.331
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean2.630-2.974=-0.344
σ0.115-0.214=-0.099
min2.481-2.687=-0.206
max2.774-3.206=-0.432
iters=5
new-facts=6402
prior-facts=1
mean4811.848-5110.326=-298.478
σ7.662-7.774=-0.112
min4808.319-5106.774=-298.455
max4825.553-5124.232=-298.679
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean8.515-9.485=-0.970
σ0.414-0.208=0.207
min7.807-9.178=-1.371
max8.861-9.742=-0.881
iters=5
new-facts=6402
prior-facts=6402
mean4999.381-5295.537=-296.156
σ0.016-0.015=0.000
min4999.360-5295.518=-296.158
max4999.403-5295.554=-296.151
mean3037.600-3068.800=-31.200
σ210.851-395.863=-185.011
min2828.000-2589.000=239.000
max3322.000-3582.000=-260.000
mean9.790-9.166=0.623
σ0.407-0.168=0.239
min9.427-9.041=0.386
max10.439-9.462=0.976

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.212=-0.228
σ0.132-0.423=-0.291
min0.913-0.917=-0.004
max1.219-1.858=-0.639

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.262-464.257=0.005
σ574.772-574.785=-0.013
min176.868-176.862=0.006
max1326.421-1326.436=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean0.438-0.560=-0.122
σ0.302-0.569=-0.267
min0.285-0.273=0.011
max0.891-1.413=-0.523
policies=20
mean1769.051-1769.003=0.048
σ0.362-0.364=-0.002
min1768.789-1768.766=0.022
max1769.581-1769.543=0.038
mean840.000
σ0.000
min840.000
max840.000
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean2.836-2.731=0.105
σ0.025-0.011=0.014
min2.816-2.719=0.098
max2.872-2.744=0.128
policies=200
mean17697.562-17697.563=-0.001
σ0.496-0.503=-0.007
min17697.173-17697.286=-0.113
max17698.280-17698.315=-0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2828.000-2589.000=239.000
σ0.000
min2828.000-2589.000=239.000
max2828.000-2589.000=239.000
mean28.138-27.784=0.353
σ0.406-0.152=0.254
min27.785-27.643=0.142
max28.543-27.961=0.582